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INTRODUCTION 


At former sessions of the International Statistical Institute; the pro¬ 
grams included Reports of Commissions established by the Institute, 
and contributed papers. The program of the Washington session differed 
substantially from this pattern. The prewar Commissions had not yet 
resumed their activity and hence had no reports to present* The Bureau 
and the Arrangements Committee, therefore, selected a number of im¬ 
portant subjects of current interest and invited experts to prepare papers 
on these topics. 

This procedure was not entirely new in the Institute. In 1935 the 
Bureau introduced the category of “invited papers’* and such papers 
were submitted at the Athens and Prague sessions; however, their num¬ 
ber was small. For the Washington session, the procedure was applied 
on a much larger scale. 

The 25th session also differed widely from prewar sessions in that it 
was one of six jointly arranged and interrelated International Statistical 
Conferences. This fact permitted a number of joint meetings in which 
two or more organizations participated. The papers submitted at the 
joint meetings in which the Institute participated are, for the greater 
part, included in this present volume. The remaining papers will be 
found in the other four volumes of these Proceedings. As a further 
consequence the Proceedings of this session are not published separately 
as Volume XXXI of the Bulletin of the International Statistical Institute, 
but as a part of the Proceedings of the International Statistical Con¬ 
ferences. The material which ordinarily would have been published as 
parts 2 and 3 of the Bulletin, is included in this volume; the material 
ordinarily appearing in part 1 of the Bulletin has been divided between 
this volume and Volume I of the Proceedings. 


G. Goudswaard 
Volume Editor 



INTRODUCTION 


Aux sessions tenues par Tlnstitut International de Statistique dans 
le pass6, le programme, scientifique 6tait constitu6 par les Rapports de 
Commissions ^tablies par Tlnstitut, et des communications presentees k 
Finitiatiye des auteurs. Le programme de la session de Washington s’est 
ecarte largement de cette tradition. Les commissions d’avant>guerre 
n’avaient pas encore repris leurs activit^s et, par consequent, n’avaient 
pas de rapports k presenter. C’est pourquoi le Bureau et le Comite 
d’Organisation firent choix de divers sujets importants d’interet actuel 
et invita des experts de preparer une communication sur ces sujets. 

Cette procedure n*etait pas entierement nouvelle pour Tlnstitut. En 
1936, le Bureau avait decide de creer une categoric de “communications 
presentees sur Tinvitation du Bureau’* et de telles communications ont 
en effet ete soumises aux sessions d’Ath^nes et Prague. Toutefois, leur 
nombre etait limite. Pour la session de Washington, la procedure a ete 
appliquee dans une mesure considerablement plus etendue. 

Une autre importante difference avec les sessions d’avant-guerre con- 
sistait en ce que la 26e session faisait partie de six Conferences Inter¬ 
nationales de Statistiques, organisees conjointement. Ceci permettait de 
tenir un certain nombre de seances communes de deux ou plusieurs des 
organisations participantes. Les communications presentees aux seances 
communes auxquelles participait I’Institut figurent pour la majorite dans 
le present volume. On trouvera le reste dans les quatre autres volumes 
des “Proceedings”. Une autre consequence est que les comptes rendus 
de cette session ne sont pas publies separement pour former le Tome 
XXXI du Bulletin de I’lnstitut International de Statistique, mais sont 
compris dans les Comptes rendus des Conferences Internationales de Sta¬ 
tistique. Le materiel qui normalement eut d^ constituer les livraisons 
2 et 3 du Bulletin est publie dans le present volume; le materiel ordi- 
nairement publie dans la premiere livraison des Bulletins figure en partie 
dans le present volume et pour le reste, dans le premier volume des 
“Proceedings”. 

G. Goudswaard 
Volume Editor 



SPECIAL MEETINGS 


WORLD CENSUS OF AGRICULTURE AND 
POPULATION 

Wedn$tday, September 17 at 9:30a,m.* 

Chairman : 

Alberto Arco Parro 


WORLD CENSUS OF AGRICULTURE 

by Conrad Taeuber 
Economics and Statistics Division 
Food and Agriculture Organization of the United Nations 

Never before have governments so urgently needed so many reliable 
statistics and never have the problems of keeping statistically up to date 
been greater. In many instances current information and current esti¬ 
mates can no longer be related to the basic data assembled for 1940 or 
1935, for these have largely been made obsolete by the course of events 
since then. In planning their own wartime and postwar programs, 
governments had an urgent need for reliable objective information about 
their own resources, and many new statistical services were started. 
The growing awareness of the interdependence of nations, and the deve¬ 
lopment of international agencies to assist governments in* achieving 
their common purposes, have increased the need for comparability in 
the statistical data supplied by nations. In an era of frequent inter¬ 
national discussion and joint planning by countries, it is essential that 
their statistical information be as coipparable as possible in order to 
V permit the drawing of valid conclusions concerning the relative posit 
tions in respect to the matters under examination. 

« Joint meeting wi^h Inter ibnerican Statistical Institutef 



4 INTERNATIONAL STATISTICAL CONFERENCES: I S I 

In recognition of such needs as these the newly founded Food and Ag¬ 
riculture Organization of the United Nations was asked by its member 
governments to assume leadership in the development of a broad cooper¬ 
ative enterprise which has come to be called the 1950 World Census of 
Agriculture. Under the program, each nation is asked to conduct a census 
of agriculture in 1950 or proximate years. Each participating country 
will conduct the census according to its own practices and in the light 
of its own administrative situation, but there is to be prior consultation 
among nations to assure that there will be comparability in the concepts 
and definitions used. A minimum set of tabulation plans is to be agreed 
upon in advance, and thus each country in planning its work can make 
provision for tabulations which will be comparable to those of other coun¬ 
tries. The FAO is expected to combine the tables supplied by the several 
countries and in that way develop an inventory of the world’s agriculture. 

This cooperative activity among countries assumes that through 
cooperation countries can enhance the value of their own efforts in res¬ 
pect to their census programs, and that no one country and no one or¬ 
ganization possesses a monopoly of the skills and knowledge necessary 
to conduct a successful census under the wide variety of economic, 
social and administrative circumstances which are found in thej countries 
of the world. Through joint study of the technical questions that arise 
in all stages of census undertaking, and through sharing of the procedures 
that have been developed, there will be a growing use of the best methods 
which the technicians of the several countries can devise. The role 
of the international agency in this undertaking is primarily one of faci¬ 
litating the free exchange of ideas, information and knowledge among 
the technicians and administrations of all countries, and not one of 
attempting to impose a rigid pattern of operations on all countries, 


Why A Census is Needed 

The need of a government and its citizens for objective, accurate, 
and timely information about its agricultural resources and its agri¬ 
cultural plant is so widely recognized that it is not necessary to belabor 
the point here. When the International Institute of Agriculture began 
its activities in behalf of a 1930 World Census of Agriculture it found 
that 37 countries had taken an agricultural census in the first 25 years 
of the present century. Today, periodic censuses of agriculture are 
provided for by law in a number of countries, some at ten year intervals 
and some at five year intervals*. These provide a comprehensive pic- 
tpro of the agriculture and of the agricultural resources of the country, 
In addi^on, a considerable numBer of countries conduct annual enumer» 
lotions on a limited number of items such as crop acreages, acreage sown,; 
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acreage harvested, livestock numbers, etc. Where a crop or a branch 
of livestock production assumes particular economic importance for 
the country, there may be enumerations at appropriate intervals 
throughout the season, in order to provide accurate and up-to-date in¬ 
formation at all times. In many countries which do not have census 
experience or a census tradition, there have been efforts to arrive at esti¬ 
mates in lieu of census information, in order that the government and 
its citizens should have at least a minimum of data on which to base 
their planning and activities. Some governments have initiated a cen¬ 
sus program by carrying out enumerations in a district or province at 
a time in order to gain experience before doing the work on a national 
basis. 

An agricultural census is an inventory of the nation’s agricultural 
resources and plant, of producing areas, of livestock, of the people who 
work in agriculture, of the conditions under which the land and other 
agricultural resources are made available to agricultural workers, of ani¬ 
mal and mechanical power and of equipment and of other important 
facts about agriculture which influence the production of food and raw 
materials and the prices that producers received and consumers pay. 

The taking of an inventory is a well recognized practice in many types 
of private and public endeavor. When combined with information con¬ 
cerning current activities, it provides an invaluable* aid in evaluating 
the successes or failures of the past. It reveals the present position, 
and provides a guide to planning for the future. Countries also.ji.eed 
a periodic stock taking. The inventory of their agriculture which is 
supplied by a census gives the country and its citizens (especially the 
agriculturalists and their representatives) the information which is in¬ 
dispensable as a guide to programs for future production and develop¬ 
ment. It serves as a guide to marketing and distribution programs 
by showing the distribution of production, and providing a basis for 
comparisons with facilities for marketing and transportation. Alert 
businessmen, whether operating privately or as the representatives of 
cooperative or publicly owned enterprises, have found such data of 
great value in planning their own operations. In the same way, manu¬ 
facturers and distributors of manufactured products have found the 
data on the distribution of a country’s agricultural resources and pro- 
■ duction a guide to their own production and distribution programs. 
The agricultural producers themselves benefit through the more efficient 
planning for agricultural production and their own welfare which is 
possibb when full information is available. An important direct bene¬ 
fit grows out of the reduction of l^mful speculation in the prices of agri¬ 
cultural commodities, for that type of speculation thrives on uncertainty 
and lack of information by the public. 
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Census data are unsurpassed aids to governments in the development 
of intelligent action and legislation for the promotion of agriculture and 
the welfare of rural people. The census provides data not only for the 
entire country but also for the smaller geographic areas, which may 
have widely differing conditions and may require special consideration 
and treatment. A census moreover brings together a body of information 
concerning the individual agricultural enterprises of the country, and 
thus provides the basis on which legislators, administrators, research 
workers, scholars, journalists, and others can study relationships among 
the factors affecting the country’s agriculture in a way which makes 
for much more intelligent understanding of conditions and problems 
that would be possible without such sources.) That this is a possibility 
which has not always been fully utilized in the past is regrettable. The 
development of newer techniques for the handling of mass data, and a 
growing collaboration between census technicians and the consumers 
of their data should make for greater realization of the possibilities of 
such use than has previously been the case. 

When countries join with each other to promote the increased pro< 
duction of food and agricultural products throughout the world, the 
improvement of distribution of such products, the improvement of nu¬ 
tritional levels and the increases of the welfare of their people, they find 
that facts about their agriculture are indispensable. They need the 
facts concerning themselves in order to evaluate the progress which 
they themselves are making, but they also need the facts concerning the 
other countries with which they are cooperating in order properly to 
evaluate the effects of trends and activities in those other countries 
upon their own people and upon, the entire international community. 
To carry out such an activity there is need for the free interchange of 
information, and a recognition of the fact that there is no lasting advan¬ 
tage to the individual country in keeping the others in ignorance of the 
true state of affairs. 


The Program for 1960 

Realizing the importance of a joint census undertaking at an early 
post'v^arddate, the delegates to the first Conference of the Food and Agri¬ 
culture Organization in 1945 instructed the Director-General to study 
the problems involved in promoting a world census of agriculture in 1950 
and to report at the subsequent conference. At the 1946 Conference 
it was agreed that the work on the 1950 World Census of Agriculture 
should become one of the early activities of the Organization, and accor- 
di^ly steps have been taken J?o get under way with this cooperative 
iPindeaVbr. 
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The first step was to prepare a minimum program which might be 
proposed for consideration by all governments, including the responsible 
authorities in non-self governing areas. The international ad hoc group 
which was convened for this purpose did. not believe that it would be 
feasible to attempt to draw up a complete questionnaire to be proposed 
to governments. Instead it preferred to develop a list of items for which 
information is to be secured, and to develop a set of definitions andtabul- 
at'on plans to accompany this list. In developing the minimum list 
the needs of countries which do not have extensive census experience 
were particularly kept in mind, and the list was confined to those items 
which are needed from all countries. It was not intended that this 
minimum list would satisfy the needs of all countries—in fact it may 
actually satisfy no one country’s needs completely. Adaptation to \ 
meet local conditions and needs, further subdivision of the items inclu- J 
ded in the minimum list and additions to that list are not only assumed, ■ 
but are actively encouraged. In the field of crops, the minimum list' 
was confined to those cro])s for which world-wide totals were deemed 
to be desirable because of the importance of the crops to nutrition or ’ 
to the international trade in agricultural products. Each country will 
need to supplement this crop list in order to provide information on all 
of the crops which are of importance to it. 

In addition to the minimum list, another list, providing for greater 
detail for some subjects and for additional subjects has been prepared; 
Its purpose is to provide a basis for securing comparability for the items 
to be included in the censuses of countries which will wish to do a more 
comprehensive census than is provided for in the minimum list. The 
two lists together provide definitions for a large number of items which 
are ordinarily included in cjensus activities, suggest uniform classifica¬ 
tions for livestock, and many other items which have given trouble in 
international comparisons in the past. In developing these lists full 
use has been made of the experience gained in the similar undertakings 
for 1930 and 1940. 

These lists of items have been submitted to governments as provi¬ 
sional and criticisms and suggestions have been invited. They were 
also submitted to many statisticians and other technicians in all parts 
of the world for their criticisms. In March 1947, the European ^govern¬ 
ments were invited to send their representatives to Rome to consider 
these proposals and other aspects of the Census program in detail. 
Representatives from 18 countries were present at that meeting. Re¬ 
presentatives of the American governments have just completed a sim¬ 
ilar review of the proposed list of items as part of the work of IASI 
in relation to the 1950 Census of the Ai^iericas. Similar meetings are 
proposed in the Middle East and in Southeastern Asia later in 1947. 
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Biscttssions have been initiated with representatives of Colonial offices 
to consider ways in which the program might be adapted to the needs 
and conditions of many of the dependent areas. After these discussions 
have been completed, a definitive list of items is to be submitted to 
governments. When this list is submitted it will have had the bene¬ 
fit of the views and experience of statisticians in a large number of 
countries. 

The question of developing a minimum or model questionnaire was 
considered at some length and was finally decided in the negative. It 
was considered that a questionnaire is a tool for securing information 
which must be adapted to the collection procedure appropriate to each 
country. This is related to past experience with censuses and to eco¬ 
nomic, social, geographical, and political conditions in the country. A 
questionnaire which is carried to the agriculturalist by an enumerator 
specifically employed to collect the information will be quite different 
from one that is taken to the agriculturalist by the enumerator and left 
to be filled in and mailed at a later date, or one that is to be used when 
the enumerator’s function is primarily that of assisting the agriculturalist 
complete a return which he has largely filled out by himself. A different 
form is required for use in a situation in which it is obligatory for each 
agriculturalist to come to a specified place, such as the headquarters 
of the village government, to supply the required information in the pre¬ 
sence of witnesses. The degree of literacy in the population has a pro¬ 
found effect on the structure and content of the questionnaire. That is 
true also of the degree to which the agriculturalists are subject to govern¬ 
mental controls in respect to their agricultural operations. The predo¬ 
minant forms of tenure and the character of agricultural holdings signi¬ 
ficantly affect the development of a questionnaire. Perhaps most im¬ 
portant of all is the realization that an effective questionnaire must 
be so developed that there is no misimvl rstanding on the part of the 
respondent concerning the information which he is to supply. That 
means that the questions must be framed so that they will have the same 
meaning to the respondent and to the statistical office. This is not only 
a matter of language but is essentially a matter of an intimate knowledge 
of the conditions imder which agriculture is carried on in the different 
areas of a country. It is essential that a questionnaire should be deve¬ 
loped in relation to the tabulating procedures to be followed. These 
in turn depend on the administrative structure of the governmental and 
on the type of tabulating equipment which is available. 

Although no uniform questionnaire appeared to be feasible, it was 
deemed feasible to develop minimum standards to which questionnaires 
should conespond. In order 4bo assist in the maintenance of compara¬ 
bility in the returns which will be secured in the several countries, 
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provision has been made for consultation between representatives of FAO 
and of the statistical services of the countries. In each of the major 
regions of the world a representative of FAO will be available to assist 
any government in the development of its census program and materials 
with a view to insuring comparability, while maintaining the maximum 
flexibility in adapting to local conditions. It is planned to summarize 
and publish information concerning practices developed in countries 
which already have census experience and to set forth in some, detail 
practices which have been found to be effective under different condi¬ 
tions. A minimum set of table outlines is in process of revision for trans¬ 
mission to governments so that they may plan their tabulations in such 
a way that comparability in the final tables will be assured. FAO 
stands ready to assist any government on request in finding tiained 
technical personnel which may be seconded to the government to assist 
in the census. 

Recognizing that adequately trained personnel is vital to the success¬ 
ful conduct of any census program, particular attention has been given 
to means whereby training in census procedures will become more readily 
available. In a number of countries with well developed statistical 
services, or with well equipped training facilities, steps are being taken 
to initiate training which combines practical experience in census pro¬ 
cedures with theoretical training in statistics. Arrangements fiave not 
yet been completed but it is hoped that a number of countries in dif¬ 
ferent parts of the world will make their facilities available to nearby 
coimtries, and that the necessary arrangements can be made so that 
trainees may benefit from such facilities. In this connection, full ad¬ 
vantage is being taken of the training facilities being made available 
by the United States to persons from other American countries. Coun¬ 
tries which have not had recent census experience are particularly in 
need of such assistance. But the need is not confined to them alone. 
Indications have come from a number of countries that the war-engen¬ 
dered shortages of technically trained personnel have also affected their 
statistical services and that there is an immediate need for training pro¬ 
grams if adequate personnel is to be available in time for the census in 
1950. A member of the FAO staff is now devoting full time to this 
problem, and the prospects are encouraging. Consideration* is being 
given also to the possibility of establishing short term intensive training 
schools in a number of areas. 

DBFnanoNS and Froblbms 

In the 1950 World Census of Agriculture it is intended that each go¬ 
vernment will obtain accurate and comparable information on its agri¬ 
culture including • 

2 
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(a) areas under crops and numbers of livestock 

^ (b) the number of agricultural holdings and their principal 

characteristics, such as size, form of tenure, utilization of the area, uti- 
Vvlijation of laboi, implements and mechanical power, etc. 

(c) the number and characteristics of people who secure their 
livelihood from agriculture, and the extent to which they also engage 
in other occupations, especially in forestry and fisheiies, and 

(d) a record of its production of all important agricultural 
products. 

It is proposed that in every country the 1950 Census of Agriculture 
shall cover all types of agricultural holdings, including those whose pro¬ 
duct is used primarily for consumption by the holder and his family. 
It is recommended that tribal and other groups which are outside the 
normal marketing system be included even though for them it may be 
necessary to resort to means other than individual enumeration of hold¬ 
ings. In this respect the effort for 1950 covers a broader field than 
that of the eailier World Census of Agiicultuie. Then the emphasis 
was somewhat more on those parts of agricultural production which 
entered into commercial channels. In broadening the scope of the 
census, recognition is given to the purpose of governments to take appro¬ 
priate steps to improve the nutrition of all their people and to improve 
the welfare of rural populations, which was accepted when they became 
members of the Food and Agriculture Organization. 

The program as submitted to governments avoids setting a minimum 
area or minimum output of the holdings to make them eligible for in¬ 
clusion in the enumeration. Instead governments are urged to make 
the minimum limit as low as possible and to inform FAO as soon as 
possible of the limits adopted. It is expected that agreement will be 
secured on the size groups according to which tabulations are to be 
presented, and thus the materials can be presented in comparable 
form. 

The 1950 World Census of Agriculture is in principle conceived of as 
a direct enumeration of individual holdings in each country. It is re¬ 
cognized that in some areas, especially those where agriculture is carried 
on by primitive people, it may not be practicable to secure a report 
from each*" individual producer and hence it will necessary to prepare 
estimates for the entire community, tribe etc. In such cases it is 
recommended that a report similar to that secured for individual hold¬ 
ings should be obtained for the appropriate unit. In such cases the 
area covered should be limited to the land under cultivation and the 
pasture lands actually used. In all oases in which such estimates are 
to be made it is especially important that the local* organizations or 
ojBKcers responsible for the estimates receive clear and precise instructions' 
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indicating the records.or other sources to be used and the methods 
by which the estimates are to be made. In such cases avoiding omis¬ 
sion and avoiding duplication of some areas or items becomes Qjfipe- 
cially important. £ 

In so far as possible it is intended that the 1950 World Census of AgflF 
culture should relate to the crops harvested in the northern hemisphere 
in the calendar year 1949 and in the southern hemisphere in the year 
from July 1, 1949 to June 30, 1950. It is recognized that in some 
countries the statutes prescribe another year, and in some other coun¬ 
tries there may be unavoidable reasons for having the data relate to 
another year. 

Although it is desired to secure information concerning the crops 
harvested, it is not deemed feasible to recommend as a general prac¬ 
tice that agriculturalists be asked to report directly their production 
of the several crops. In many coimtries the methods of harvesting, the 
threshing practices, and utilization practices make it dijficult for the 
holder to report with any degree of accuracy the total production of the 
crop realized on his holding. In addition, there are some areas in 
which resistance to reporting production is likely to be encountered 
because respondents are not fully convinced that the legal provisions 
for holding the returns confidential will actually be observed. There¬ 
fore, chief attention is to be given to areas harvested and it is strongly 
urged that every government take the census as soon as possible after 
the main harvest season has ended for the year (usually when the bulk 
of the row crops have matured or have been harvested) and before general 
planting operations have started for a new crop season. Some coun¬ 
tries have, by custom or law, taken censuses at another period in the 
year. In a number of countries enumerations are customarily made 
of areas sown instead of areas harvested and for some of these it has 
been ascertained that there is ordinarily very little difference between 
area sown and area harvested. However, in all instances in which a 
country cannot enumerate area harvested, it is urged to supply esti¬ 
mates of the differences between the area sown to different crops and the 
area actually harvested. 

The definition of an agricultural holding or farm is essentially the same 
as that used in the 1930 and 1940 censuses. A holding according to this 
definition includes all land used wholly or partly for agricultural pn:o- 
duction that is operated, directed, or managed by one person alone or 
with the assistance of others, without regard to title, size or location. 
It may consist of two or more parcels of lands, even if widely separated, 
provided that:they form a part of the same technical and economic 
,unit. Enterprises not including any cultivated land but producing 
livestock or livestock products arl to be considered as farms or 
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agrioultiiral holdings, regardless of their location. Essentially, in order 
te be classified as an agricultural holding, an enterprise must produce 
a^bultural products and must be a unit in the technical and eco- 
sense. 

Siioh a generalized definition leaves much to be worked out in 
the individual countries. It is clear for the great bulk of agricultural 
holdings in all parts of the world including those under individual 
proprietorship or leased by an individual, and those which are operated 
under some pattern of cooperative, communal, or public ownership 
or management. There are numerous problems still to be worked out 
in this connection, for the variations in tenure relationships are infinite. 
Some types of plantation and multiple holdings—such as those in parts 
of the southern United States—do not readily lend themselves to clear- 
cut classification. There are many degrees of economic and technical 
responsibility between that of the laborer who assumes no responsi¬ 
bility and that of the proprietor who operates his own holding and 
assumes full responsibility. These situations will require careful study in 
order to arrive at consistent, meaningful, and comparable classifications. 
In some cases it may be necessary to request the government to secure 
the information in such a way that alternative methods of classification 
may be utilized. 

The problem of-securing information on the production of livestock 
and poultry products has been the subject of extended study. The 
nutritive value of such products, particularly meat, milk, and eggs, 
makes it especially urgent that information about them be secured. 
The fact that these products, particularly milk and eggs, are “harvested** 
daily and that the yield per unit is subject to wide seasonal variations 
makes it particularly difficult to secure useful infoimation for such pro¬ 
ducts. For these items it is proposed to secure through the census enu¬ 
meration information for only one day, t.e., the day preceding the enu¬ 
meration. This is a figure which the holder should be able to report 
without diflSculty, and in most instances the enumerator collecting 
the information could verify the holder’s report, should that appear 
necessary. 

This is at best a partial answer. Such figures by themselves cannot 
be used for making comparisons of rates of production of animal pro¬ 
ducts or of total production in the several countries. When supple¬ 
mented with other information, they can, however, be used as a basis 
for estimating total production during a year or parts of a year. 
Because production varies from season to season, governments are 
urged to prepare estimates of seasonal changes in production or esti¬ 
mates of production for a week„ a month, and wherever possible, a 
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The treatment proposed for data on the production of crops and live- 
stock products illustrates one basic element in the approach. That ^ 
to view a census as an important element in a program of agriculti||P 
statistics, but not as the only part of such a program. In order to 
data on crop acreages useful they must be supplemented by estimates 
of yields. Governments which have made such estimates in the past 
are generally agreed that yield estimates do not lend themselves readily 
to the techniques of census enumerations. Governments that have 
not in the past made cmrent estimates of production will find the census 
data on crop acreages indispensable in order to interpret the yield esti¬ 
mates. Likewise, the data on livestock products proposed in the cen¬ 
sus program will be of very limited value unless there also are' estimates 
for parts of the production cycle other than the one included by the 
date of the enumeration. On the other hand, current estimates of the 
yield of livestock products would benefit substantially from the objec¬ 
tive and comprehensive data supplied by an enumeration. 

The value of the data collected in a census is enhanced if at the same 
time related information is secured, and if the several data collecting 
activities are closely coordinated. Because of the close relationship 
among agriculture, forestry, and fisheries, it is suggested that wherever 
feasible, censuses or surveys of certain aspects of forest industries 
and fisheiies be undertaken concurrently with the 1950 Census of Agri¬ 
culture. It is also proposed that the data on use of the land which is 
included in agricultural holdings be supplemented by estimates of the 
total land area of the country and of the major uses of the land not in¬ 
cluded in agricultural holdings. The information to be secured as part 
of the census of agriculture is necessarily limited to the land included 
in agricultural holdings. If the other information could be secured at 
the same time, both sets of data could be more readily related to each 
other, and one check would be provided on the completeness of the census 
enumeration. 

Information on the number and characteristics of people who secure 
their livelihood from agriculture and the extent to which they also engage 
in other forms of gainful activity is regarded as primarily a matter for a 
census of population, and it is urged that wherever possible, the census 
of agriculture be coordinated with a census of population and the data 
from the one be directly related to the data from the other. In cases 
in which that is not possible it is proposed that a brief section on the 
agricultural population be included to provide a minimum amount of 
information on age and sex distribution and on the degree of partici¬ 
pation in agricultural activity. 

Because of the possibility of enhancing^ reliability, saving of funds, 
and speeding the publication of results, there is growing interest in the 
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.told .of sampling in^a census program. Sampling has been used in con- 
;^ectioii With census activities for foui major purposes: (a) to secure 
is^itional information which could not be secured from all persons 
dpRuded in a complete enumeration, (b) to test the reliability of the cen- 
t;Sus, <c) to reduce Costs and speed up tabulations, especially the more 
/complex tabulations, and (d) in lieu of a complete enumeration. Sam- 
\pMixg methods have also been found efifeotive in the control of various 
r.opel:atioh)8 of a census,'enumeration, coding, editing, and card punching, 
r Kow sampling may best be'used as part of the census program will depend 
. on the uses to which the data are to be put. Since a sampling program 
. must be adapted to the* purposes to be served and the situation in which 
.r.it is to be applied, no one sampling method for general use has been pro- 
. posed. ; It is proposed, however, that the rapid advances in the appli- 
cation of sampling methods to enumerative procedures should be uti- 
..Jized in. connection with the 1950 World Census of Agriculture. 

This report is an interim i‘eport on an activity that is now under way. 

.' As of September 15, 1947, thirty-seven countries had stated that 
iijbhey expected to participate actively in the 1950 World Census of Agri¬ 
culture, and many others have indicated an interest. A definitive 
.'proposal will be submitted to governments as soon as the proposed 
; discussion with technical representatives of countries have been com- 
• pleted. The more detailed process of working out the necessary national 
; adaptations to the over-all prdgram is under way and will continue. A 

V training program is expected to be well under way by midwinter. Mate¬ 
rials summarizing the experienbe of countries that have taken censuses 

c in the past are being prepared and will be made generally available, 
i The staff of FAG stands ready to assist governments which requests 
assistance in the census undertaking, and it has been assured the assis- 
"tance of countries that have well developed statistical programs. FAG 

V plans to publish international tables summarizing the results as quickly 
as they become available. Sinc^ this is a cooperative undertaking in- 

, VOlying many governments and many persons, ^it is not possible at 
^this time to state definitely what the outcome will be. This is the third 
.time that a World Census of Agriculture has been discussed before the 
. International Statistical Institute. We look forward to the time when 
we shaJI be able to lepoit the successful completion of so ambitious an 
^ undertaking. 
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Risumi * 

La reconnaissance de plus en plus g6n6ral de Tinterdependance tics ■ 
nations, et la creation d’organisation internationales pour aider les 
gouvernements h atteindre leurs objectifs communs, ont fait grandir- 
la n6cessit6 de atatistiques comparables. Reconnaissant cette n6ces- 
sit6, les Etats Membres de la FAO (Organisation des Nations Unies . 
pour I’Alimentation et TAgriculture) lui ont demand^ d’assumer un 
role dirigeant dans le recensement mondial de I’agriculture en 1950. 

Le role de la FAO dans cette entreprise est principalement de faci- 
liter, entre les techniciens et les administrateurs des divers pays, des 
^changes de connaissances, d’idees, et d’informations concernant les 
techniques et les m^thodes employees, plutot que de tenter d’imposer 
a tous lea pays I’usage d’un questionnaire uniforme et rigid*^. 

On a tout d’abord convoque un groupe international ad hoc pour, 
preparer un programme minimum k soumettre a tous les gouvernements, 
y compris lea autorit^s responsables des teiritoires sous tutelle. Le 
programme minimum comprend une liste de matiferes pour lesquelles il 
est des plus urgent d’obtenir des statist!ques internationales, ainsi que 
des notes explicatives et les definitions proposees. Une seconde liste, 
plus complete, comprend outre plus de details sur certaines questions, 
des matiferes suppiementaires sur lesquelles il est desirable d’obtenir 
des renseignements. 

Apifes que le programme fut soumis aux gouvernements, des conferen¬ 
ces eurent lieu a Rome (en mars 1947) et k Washington (en septembre 
1947), au cours desquelles ces propositions et d’autres aspects du pro¬ 
gramme furent etudies en detail par les representants des gouveme- 
ments europeens et americaines. 

Etant donne la necessite de disposer d’un personnel bien entraine, 
une attention toute speciale a ete consacree aux moyens par lesquels 
I’entrainement dans les methodes de recensement pourraient etre plus 
largement repandus. Dans certains pays oil les services de statistique 
sont bien organises et outilies, on s’occupe de preparer des couns d’en- 
trainement comprenant tant I’experience pratique des methodes de 
recensement que I’enseignement theorique de la statistique. On envi¬ 
sage aussi la possibilite d’etablii, dans certaines regions, des centres 
d’entrainement intensif de courte duree. 

On vise k ce que chaque gouvernement obtienne pour le recensement 
mondial de I’agriculture en 1950 des renseignements comparables et 
exacts en ce qui concerne I’agriculture de son pays, comprenant tous 
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les genres d'exploitations, en compl^tant les donniSes recueillies lors du 
d^nombrement complet, par des 6valuations et des Bondages. 

Au 1®** septembre 1947, 37 pays avaient fait savoir qu’ils partioipe- 
ront au recensement de 1950, et plusieurs autres avaient montr4 un 
certain int^ret dans Fentreprise. Les travaux d’adaptation des plans 
aux diverses n4cessit4s d’ordre national ainsi que le programme d’entra!- 
nement statistique sent en bonne voie. 

La FAO envisage la publication de tableaux internationaux r^sumant 
les r^sultats du recensement au fur et k mesure qu’ils seront disponible. 



fitE 1^50 CeKsUS 6F THfe AMERICAS 


by Calvert L. Dedrick 
Coordinator, International Statistics 
Bureau of the Census {United States) 

It is appropriate to note at the beginning of this brief report on the 
plans for and problems of the 1950 Census of the Americas that just 
fifty years ago the International Statistical Institute, at its St. Peters¬ 
burg session in 1897, considered recommendations which could be 
made for a world census of population to be taken in the year 1900. 
The pioneering efforts of the ISI in attempting to secure international 
uniformity in methods of collecting and presenting census data should 
be recognized by everyone interested in plans for internationally com¬ 
parable censuses. 

Statisticians from several of the American nations were present at 
sessions of the ISI which discussed census plans, and they were instru¬ 
mental in securing the passage by the Conferences of American States 
in 1910 and 1923 of resolutions recommending that the participating 
governments take decennial censuses of population and exchange tech¬ 
nical information as well as statistics. Although these early recommen¬ 
dations as to standards and international cooperation were helpful, 
they were not entirely successful because they lacked leadership and 
an organization devoted exclusively to this purpose. It appears that 
no really effective steps were taken to coordinate the censuses of the 
American nations in 1930 or 1940. 

The genesis of the present activities for a 1950 census of the Americas 
is not found in these early recommendations and resolutions, but in the 
fortunate combinations of a leader who can make ideals a living reality, 
an organization devoted exclusively to inter-American statistics, and 
an inter‘American congress considering demographic problems. 

The leader is Dr. Alberto Area Parr6 who, as chairman of the Demo¬ 
graphic Statistics Committee of the Inter American Statistical Insti¬ 
tute (the organization), and Director General of Statistics in Peru, wrote 
to the other Director Generals of the Americas on June 7, 1943, sugges¬ 
ting the great desirability of a population census of all the American 
nations in 1950. In this letter Dr. Area suggested the first practical 
steps toward such a census as: (a) the exchange of census documents 
and experience; (b) the technical determination of the type and mini¬ 
mum content of a decennial census form which could be used in each 
country without prejudice to its amplification to meet national needs; 
and (c) the preparation of national laws providing for such a census^ 
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and for necessary financing. The response to this suggestion was imme¬ 
diate and favorable. 

The Inter-American Demographic Congress, which met in Mexico 
City in October 1943, considered and approved Dr. Area’s proposal. 
It formally requested the Inter American Statistical Institute to take 
such steps as might be necessary for an inter-American population cen¬ 
sus in 1950. A project for a census of the American nations was imme¬ 
diately incorporated in the program of the Institute and, at the first 
meeting of the Executive Committee, in January 1946, a new committee 
was created for this purpose. 

Additional endorsements of this project were received from the Pan 
American Consultation of Geography and Cartography (Rio de Janeiro, 
Sept., 1944), the Inter American Conference on Agriculture (Caracas, 
July 1945), the Inter American Defense Board (Washington, August 
1946), and the Economic and Social Council of the United Nations 
(March 1947) after recommendations by both the Statistical and Popula¬ 
tion Commissions. 

Between September 2 and 16, 1947, nearly 100 men and women repre¬ 
senting all of the 22 American Nations participated in round table dis¬ 
cussions and plenary meetings of the First Session of the Committee 
on the 1950 Census of the Americas. The Committee is composed of 
one technical represenfiative of the general statistical agency or, in some 
cases, the population census agency, of each of the American Nations, 
and of observers from three international organizations : the United 
Nations; the Food and Agriculture Organization; and the Pan Ame¬ 
rican Union. This Committee was supported by nearly 70 technicians 
from the countries involved, 

Time does not permit an adequate presentation of all phases of the 
Committee’s work, including the working papers considered or future 
plans of the 1950 Census of the Americas. Documentation of the pro¬ 
gram will be available in the near future. This paper, therefore, will 
be limited to the presentation of a selection of the principal actions of 
the Committee and a brief outline of some of the technical and admi¬ 
nistrative problems which remain to be solved. 

The 1950 Census of the Americas is really not one census but twenty- 
two. Each country of the Western Hemisphere is now planning to take 
a census of population during, or within six months before or after, 1950. 
As ^ilways, these censuses will be taken primarily to provide data for 
the nation itself but ^ith, the new objective of using, insofar as possible, 
a u.!^ifprm list of topics and classiheations which will provide date on 
an internationally con^parable basis. 

The Committee has recognized that if there are to be international 
standards for statistics which will be ^used in all countries, they must 
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be very practicable standards which are designed to satisfy the needs 
of these countries. The Committee has .demonstrated, in the opinion 
of the writer, that the best way to arrive at such standards is’ to sit 
down around a conference table and^ after adequate discussion of the 
mutual and special needs of national and international organizations, 
to arrive at provisional items which can be adopted in principle. The 
next step, of course, is to test these* standards and, in future meetings, 
to adjust and readjust them until they fit insofar as possible both 
national and international needs. 

One of the fundamental objectives of the first session of the Commi¬ 
ttee on the 1950 Census of the Americas has been the adoption of uni¬ 
form items and definitions for population census purposes, and uniform 
methods and procedures which would provide comparability of results 
among the 22 censuses were also considered. 

During this first session the Committee has reached a substantial 
agreement as to certain items which should be included in the popula¬ 
tion census program of the American Nations. For example, the foll¬ 
owing items have been included in the inter-American minimum popu¬ 
lation census program without much diflSculfy: 

1. Sex 

2. Age' 

3. Place of birth (For the native born^ the State or other major ter¬ 
ritorial division. For the foreign born, the country they report.) 

4. Naturalization (For the foreign born,* indicate if the person is na¬ 
turalized in the country in which the census is taken.)- 

5. Literacy (Does this person know how to read and write? Yes, 
or No.) 

In addition to these, a number of items have been included in the 
minimum census program subject to- further study as to the exact de¬ 
finitions and classifications to be used. Such studies will be conducted 
under the auspices of the coordinating board of the Committee and the 
results will be considered in the next session of the Committee. All of 
the studies on these items will take into account consultations with na¬ 
tional and international organizations. Items* included in the minimum 
program but subject to further study are the following: 

1. Relationship to head of the family (principal problem—the ‘‘cen¬ 
sus family’’) 

2. Marital status (principal problem—common law., marriages) 

3. Instructional level (principal problem—an international measure 
of the amount of schooling). 

4. Mother tongue 

5. Gainfully occupied population (principal* problem—definition 
of groups to be included, applicable* throughout the* hemisphere ; 
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and adequate international classiflieations of the following items 
concerning each person included as belonging to the gainfully 
occupied group): 

a. Individual occupation 

b. Industry 

c. Class of worker 

The Committee did not include in the minimum census program, 
at this first session, the following subjects for which definitions and 
classification standards are to be studied. On the other hand, because 
of their outstanding importance, they are considered as possible candi¬ 
dates for later inclusion in the minimum program provided adequate 
international definitions and classifications can be dev,eloped; 

1. Nationality 

2. Income from wages and salaries 

3. Fertility 

4. Cultural characteristics (of the indigenous populations, for regional 
use) 

5. Data relating to dwelling units for possible inclusion in the popu¬ 
lation census questionnaire in the event that a separate census 
of housing cannot be taken. 

6. Urban and rural population (especially the definition of a “place*’) 

7. Agriculture population, total persons economically depen¬ 
dent on agriculture. 

The Committee is also recommending for the minimum inter-Ameri¬ 
can population program the securing of a de facto total population of 
the country as a whole even in those countries which by law are required 
to take a de jure census. It is also recommending that the enumeration 
of population be conducted as rapidly as possible, preferably in a single 
day, and if possible, in not more than one week in rural areasi As to 
method of enumeration, the Committee has indicated a preference for 
enumeration by house-to-house canvassers, though without prejudice 
to the use of forms made out by the head of the household in those 
carSes where this is feasible. 

The Committee on the 1950 Census of the Americas assigned to one 
of its principal subcommittees the problem of aiding the Food and Agri¬ 
culture Organization of the United Nations with the problem of agri¬ 
cultural censuses in the American Nations which will be taken in or 
about 1950 as part of the World Census of Agriculture. The Committee 
is interested both in securing agriculture censuses in this hemisphere 
and in the coordination of these censuses with population inquiries as^ 
part of the 1950 Census of the Americas. 

The Committee has also un^^ertaken as future work the development. 
oi iiiteraatipnal st^rndard^ in economic censuses spcb e^s commercej^ 
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industry, transportation, etc. The tremendous need for data of this 
type is amply recognized, and studies will be made by the Committee 
in cooperation with the national statistical offices of the American nations 
and its parent organization, the Inter American Statistical Institute, 
so that as much information as possible can be considered at the next 
meeting of the Committee in 1948. It is of considerable interest, I believe, 
that the Committee has indicated that one of the objectives of these 
economic censuses is the securing of data which will facilitate the 
calculation of national income estimates. 

Time does not permit the review of all the other actions of the Commi¬ 
ttee, but a brief listing of some of the points on which agreements 
have been reached includes: census legislation; the organization 
of census offices; cartographic materials for census purposes; tabu¬ 
lation procedures; a published guide to census procedures and analysis; 
the financing of the Committee’s work; provision for future sessions 
of the Committee; regional Institutes for training census personnel; 
and relationships with the United Nations and other international or¬ 
ganizations. On the last point it is significant that the Committee 
has instructed its governing board to consult with the international 
organizations interested in the Census of the Americas and to use inter¬ 
national definitions and classifications wherever possible. 

The Committee expressed its appreciation to the Economic and 
Social Council and the Population and Statistical Commissions of the 
United Nations for their interest in and approval of the Census of the 
Americas. The Committee’s Chairman is instructed to keep the Secre¬ 
tary General of the United Nations informed as to resolutions and other 
matters resulting from activities of the Committee and, in return, 
the Secretary General of the United Nations is requested to keep the 
Committee informed as to the development of uniform standards and 
international census plans of the Economic and Social Council and its 
commissions. 

Great progress has been made in making the 1950 Census of the Ame¬ 
ricas a reality. But a tremendous amount of work remains to be done 
both nationally and internationally. Quite apart from the technical 
problem of attaining comparability of information among the censuses 
of the Americas, and not subject to the same type of scientific^research 
and agreement, are the very grave administrative problems which must 
be faced if all of the American nations are to take a census in or about 
1950. 

Without attempting to make an exhaustive list of such administrative 
problems, the writer calls attention to the following: 

1. Several of the American nations g,re almost completely lacking 
in census traditions, ue„ in the public acceptance of and cooperation 
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{OTtp%BiQdiQ:>p(»|^l?^tion censuses.- For exaftiple, one country has not 

Rr.ci^fiU^/siuQe ^he. period of its independence; two countries, though 
they have had . emimer^^ have not published tables even on such 

population facts as sex and age. Two more have been with- 
put^ census of population since 1908 or .earlier. A number of other 
"countries ^s jvpll jare not conditioned to regular enumerations. With- 
'out this census. tradition the public has scant interest at best and, at 
vrprst, is,openly, opposed to the enactment of adequate census laws and 
the provision of sufficient funds to make periodic censuses possible. 
Undei;^these circums^nces there is need for courageous leadership on 
the part of public administrators who realize the tremendous need for 
"ppipulation data. 

A number of countries have no continuing census organization. 
This is one of the most serious defects in the present statistical organi- 
[zation of the American nations, .and one of the major factors contributing 
to the cost of population censuses in many countries. Fortunately, 
't^ere is agrowing realization of the importance of maintaining at least 
a cadre qf trained personnel within the national statistical organization 
jlduring the interim between decennial enumerations. 

3. A third administrative problem and one quite closely related to, 
though independent of, the lack of census tradition, and lack of organi- 
,zation, is the lack of suflftcient finances for the census program as a ,whole. 
The American nations have been fairly liberal in providing funds for 
the enumerative phase of the censps. But these funds have often been 
made available so late that there were inadequate expenditures on pre- 
^P^ratory work. Tqo often the interest of high public officials and of 
"the public has lagged immediately ajFter the enumeration with the result 
tl|.at insufficient funds were made-available for the adequate tabulation 
^ and publication of data. It should bo one of the objectives of each of 
the American nations, in preparing for its census in or about 1950, to 
budget its census funds in such a manner that money is available fpr 
©very phase of the census. 

^. ,4^. A fourth administrative problem of considerable importance is 
thc^t of integrating in advance the results of the censuses of population 
and agriculture with current statistical data in many fields such as vital 
^.^^tistigs,. education, criminal-judicial statistics, cost of living, agricql- 
;.tural estimates, etc. To be successful, this integration must be made 
V ^11 the very early stages of census planning. The exact manner of inte¬ 
grating the current statistical programs of many agencies with the major 
^project of a decennial census, is- a matter which must be worked out 
in each country in accordance with its own laws, traditions and existing 
organizations. 

In conclusion, I yish to quote from a speech on inter-American cen^ 
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»uses given by S. N. D. N ort h, former director'of the U. S. Census^ 
at the First Pan American Scientific* Congress, Santiago, Chile, ' De* 
cember 25, 1908, to January 5, 1909: ^ . 

“General Francis A. Walker, who was superintendent of thife 10th and 
11th Censuses of the United States,, .once remarked that ‘the people 
of the United States are well able to pay for the very best census they 
can get;' and the people have proved each decade that he was right. 

“If I may be permitted to paraphrase his remark, I will conclud€i 
by saying that the people of no South American country can afford 
not to pay for the very best census they can get, periodically taken, at 
least once every ten years, covering as many lines of national activity 
as possible, and taken in accordance with a uniform plan.”^ « 


Resume 

Du 2 au 16 septembrc 1947, une centaine de statisticiens repr^sen- 
tant les 22 nations am^ricaines ont pris part k la premiere session du 
Comite du Recensement des pays de TAm^rique en 1950, organis6e 
par rinstitut Inter-Americain de Statistique. L'un des objectifs 
principaux de cette session etait Tadoption de definitions uniformes, 
et, dans la mesure du possible, de m6thodes et procedures uniformis6es 
pour le recensement de la population. 

Le Comite a abouti a un accord de principc sur certains points qui 
devront figurer sur le programme minimum du recensement de la popu¬ 
lation. Les points suivants furent adopt6s sans grande difficult^: 
sexe, 4ge, lieu de naissance, nationalit6, et analphabetisme. En outre, 
le programme minimum devra contenir les questions suivantes qui, 
toutes, font I’object d’une etude plus approfondie quant k leurs 
definitions et classifications: parente avec le chef ue famille, itat 
matrimonial, degre d’instruction, langue maternelle et, pour la popu¬ 
lation active, la profession individuelle, Tindustrie oh on Test occupe 
et la position dans la profession. Plusieurs autres questions furent r^ser- 
v6es pour un examen ulterieur. Le Comite a decide egalement de s’occu- 
per de Tuniformite Internationale dans les recensements economiques 

^ North, S. N. C., “Uniformity and Cooperation in Census Methods of the 
Republics of the American Continent,” Ajjier, Stat, Asa^n» Journal, No. 84 
(December 1908), p. 295 ff. 
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(commerce, industrie, moyens de transport, etc.) des pays de 
rAm6rique. 

Un grand progr^s a r6alis6 en ce qui concerne le recensement des 
pays de TAm^rique en 1960. Toutefois, ce progr^s a 6t6 fait en grande 
partie dans le domaine technique, et si les 22 nations am6ricaines doivent 
proc6der k un recensement en 1950, plusieurs problems trfes importants 
d’ordre administratif devront encore Stre r6gl6s. Ce sont: la 
creation d’une opinion publique favorable dans les pays d6pourvus de 
tradition dans le domaine des recensements p6riodiques, la creation de 
Bureaux de Recensement permanents, la formation du personnel 
n6cessaire, Tobtention de cr6dits et Tint^gration du programme de 
recensement dans les statistiques courantes de chaque pays. 
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Discussion 

Mr. Davis felt that Mr. T a e u b e r had overstated the value of an 
agricultural census. He recommended that previous census experiences 
be analyzed by the present planners. Mr. Davis urged limitation of 
scope rather than incomplete or imperfect coverage within a broader 
scope. 

Mr. Davis urged prompt publication of results, with exaplanations of 
the data to prevent their misuse. 

Mrs. Czerniewska discussed the difficul^s which'will be involved 
in the taking of a Census of Agriculture on the European continent. In 
the first stage, methodological and technical preparation of the census, 
most European countries have tradition and experience. The decision 
to incur the expense of a census, however, will be a difficult one for the 
European nations to make. 

The carrying out of the enumeration, said Mrs. Czerniewska, will 
present the greatest difficulty; because of wartime requisitions, quotas, 
etc., the agricultural population will have a hostile attitude toward the 
enumerator. Mrs. Czerniewska commented that means must be devised 
to allow for the inclusion of some lands which are operated by 
communities. 

The handling of results, finally, is of great importance to the success 
of the census. Mrs. Czerniewska concluded that it is most important 
that the FAO reach an agreement with the participating countries, which 
have already approved the minimum program, with respect to the order 
of handling and a timetable for delivery of results. 

Miss M i r 6 commented on the three problems which the Committee 
on the 1950 Census of the Americas has proposed for study in the Latin 
American countries : (1) the utilization of population censuses to test 
the efficacy of birth registration; (2) the possibility of reorganizing the 
civil registers before the 1950 census; (3) the calculation of a coefficient 
of census omissions. 

Mr. L o y o remarked on the census tradition of Mexico, but added 
that as in Europe, the American nations will have to economize in the 
census operation. He noted that interchange of technical e32)erience 
will be an important factor in achieving the most efficient operation. 

Mr. Man:sour suggested that all nations participating in the 1950 
censuses should receive guidance from the UN and its Specialized Agencies 
on problems concerning the accuracy of results. He proposed that 
there should be a recommendation .to national govermennts that legis¬ 
lation be passed to enforce the census taking operations, and establishing 
secrecy procedures. • 

4 
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Mr. Weiss commented that: 

‘‘Any inventory of agricultural resources, be it that of livestock, 
crop yield, or farming in general, must consider the dependence of all 
agricultural activities on external forces that act in time and space, that 
is in a four-dimensional continuum. 

“Care must be taken to exclude abnormal events such as inundations, 
droughts, the occurence of unusual losses due to extraordinary severe 
hailstorms, plant diseases, or cattle pests, because in all these instances 
we cannot rely upon the law of great numbers which is only applicable 
in the case of random distribution of discrete universes. 

“The spatial distribution of agricultural activities introduces an 
element which, though important also in other censuses such as popu¬ 
lation, manufactures, etc., never reaches such decisive significance as in 
any instance where land utilization is involved. 

“It is a strange fact that statisticians have been more concerned with 
distribution in time than with the equally important distribution in 
space. As a result we are in a position to determine time series with some 
precision while we are unable to deal with space in an equally exact 
manner....Neither measurements of central tendencies nor measurements 
of dispersion reveal the one factor which is of so great importance in any 
appraisal of land utilization, namely the evenness or unevenness of 
distribution.” 

Mr. Lieu pointed out that China will need a great deal of technical 
assistance in preparation for taking a census of agriculture. He s ^ ges- 
ted,’^also, that in China it might be advisable to use sampling me hods 
instead of attempting a complete enumeration. 

Mr. Yates supported Mr. Lieu’s plea for the full use of sampling 
methods especially (1) to obtain production estimates; (2) to be more 
sure of obtaining honest answers; (3) to make more efficient use of skilled 
enumerators; (4) to achieve the maximum economy of operation. 

Mr. T a e u b e r indicated that the FAO is planning to organize train¬ 
ing programs and in other ways to utilize the available technical 
experience. 

Dr. D e d r i c k discussed training programs which have been set up 
in the U.S. He pointed out to Mr. Yates that, while he supported the 
use of sampling, he was aware that a sample survey poorly taken can do 
irreparable harm to the results, to the agency, and to statistics itself. 
Mr.' P e 1 a y o also participated in the discussion. 




SAMPLING THEORY 
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THE INFLUENCE OF AGRICULTURAL RESEARCH 
STATISTICS ON THE DEVELOPMENT OF 
SAMPLING THEORY 

by Frank Yates 

Rolhamsted Experimental Station, England 

When I was invited to contribute to the present discussion I was 
asked if I would be willing to give a general paper on the development 
of sampling theory, omitting only the recent developments in the 
United States, which are to be covered by Professor C o c h r a n’s paper. 
Since time was short, however, I decided that it would be better if I 
dealt mainly with that aspect of the subject with which I am most fully 
acquainted, namely the contributions of agricultural and biological 
statistics to sampling theory. The ground to be covered even under 
these more limited terms of reference is very considerable, and by limit¬ 
ing the scope of the paper I am enabled to give somewhat more detailed 
treatment of this aspect of the subject. 

I understand that it is the task of this session to deal with the deve¬ 
lopment of sampling theory, and that the practice and applications will be 
dealt with elsewhere. Some reference to practice must however be made, 
because the technique of sampling has reached its present state by a cons¬ 
tant interplay of theory and practice. Indeed I believe that no branch 
of statistics is likely to develop very far without such interplay. Cer¬ 
tainly in all the fields with which I have been associated progress has 
occurred in this way. 

♦ Joint meeting with The Econometric Society (Arranged by the American Statis¬ 
tical Association). 
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The development of sampling theory in biological statistics (and under 
this head I include agricultural research statistics) has been largely a 
byproduct of advances in related fields. When confronted with samp¬ 
ling problems workers have tended to use and adapt techniques with 
wMch they are already familiar. In particular, the theory of experi¬ 
mental design (and the associated theory of the statistical analysis of 
the results of experiments) has had a powerful influence on sampling 
theory which I will now proceed to trace. 

The Design op Experiments and the Analysis op Variance 

The principles which form the basis of the modern theory of the de¬ 
sign of experiments were developed by R. A. F i s h e r and his co-workers 
at Rothamsted in the years immediately following the first world war. 
Six principles are involved: replication, local control, randomization, 
splitting of plots for subsidiary treatments, factorial design, and con¬ 
founding. Only two of these, randomization and confounding, were 
new. The remainder had all, at one time or another, been used in agri¬ 
cultural field trials, though the recognition of their interrelation is due 
to the Rothamsted school. 

A new technique, that of the analysis of variance, was developed con¬ 
currently, in order to provide estimates of the errors to which the results 
of the experiments were subject. The interrelation between the design 
and analysis was recognized. Parallel development of the theory of 
tests of significance, and in particular the t and z tests, enabled the esti¬ 
mates of error to be used in exact tests of significance. 

Application to the Sampling of the Plots of Agrxcultu RAL 
Field Trials 

Efficient application of the above principles to agricultural field trials 
requires the use of a large number of small plots in each trial. The full 
harvesting of these numerous plots created difficulties, and it was natural 
that the possibilities of sampling the individual plots for yield by har¬ 
vesting small areas or single plants should be explored. 

It was also natural, since the workers concerned were fully imbued 
with the need for randomization in the design of their experiments, that 
they should insist on the selection of these small areas or plants at ran¬ 
dom. 1?his both avoided bias and enabled a valid estimate of the samp- 
ling error to be obtained. The principle of local control was also called 
into play for the reduction of sampling error by the division of each plot 
into a number of parts (e.gf., halves or quarters), and the selection of an 
equal number of sampling units from each part. This corresponds to* 
the ^^stratification” used in economic and sociological sampling. The 
analysis of variance provided rf ready machinery by which the sampling; 
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error could be calculated in such cases. It led naturaUy to the elimi- 
nation of the differences between parts of a plot (which, when there 
are an equal number of sampling units in each part, do not affect the 
sampling error), to the pooling of the estimates of error from each plot 
or part of a plot and to the comparison of the sampling and experimen- 
tal errors. 

Thus, in a variety trial with five replicates of each of fuur varieties, 
if 12 sampling units were taken from each plot, 3 from each quarter plot, 
mechanical extension of the analysis of variance ordinarily employed 
for the analysis of replicated experiments automatically led to the table: 


Blocks 
Treatments 
Experimental error 

Subtotal 
Quarter plots 
Sampling error (within 
quarter plots) 


Total 


Degrees of freedom 
4 
3 
12 

19 

60 (3 D.P. from each plot) 

160 (2 D.F. from each 
quarter plot) 


239 


The first reported investigations into the sampling of agricultural 
experiments for yield were made by Clapham (1929, 1931) and 
W i s h a r t and Clapham (1929). The latter paper, dealing with the 
sampling of potatoes, introduced the important additional principle of 
complex sampling units, each sampling unit consisting of every 20th 
plant in each row, the pair of sampling units chosen being determined 
by random selection of two numbers between 1 and 20. Considerable 
investigation was undertaken about this time on the relative efficiency 
of various types of complex sampling unit. 

Here again the background of experimental design and the analysis 
of variance provided the correct solution to the problem of estimating 
the sampling error of complex units. It was immediately recognized 
that the variation of the measurements appertaining to the separate 
members of each unit was irrelevant in the calculation of the sampling 
error—all that was required was the mean or total of each unit, just as, 
in the estimation of experimental error, only the total yield of all the 
plants on each plot is required. Thus th^ whole complicated structure 
of correlation was done away with. 

The sampling of agricultural field trials was not limited to determi¬ 
nation of yield. Sampling observations were frequently taken to deter¬ 
mine various characteristics of the grov^th of the plant, including such 
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filings as leaf area, ohemioal oomposition, etc., at various stages of ma¬ 
turity. These applications are inherently more interesting than is samp¬ 
ling for yield, since in oases where the observations demand detailed 
measurements on individual plants, or their destruction, sampling is ^ 
necessity, whereas in the case of yield sampling can always be replaced 
by complete harvesting if this appears desirable. 

One important series of observations of this type was that carried out 
under the Agricultural Meteorological Scheme, in which the growth of 
two standard varieties of wheat sown in replicated plots at several cen¬ 
ters was observed, with a view to determining the effect of meteoro¬ 
logical factors (Barnard, 1936). The observations ran for seven 
years, when they were interrupted by the war. They had an important 
influence on the development of crop forecasting. Examination of the 
results accruing during the first few years, for example, suggested that 
the crop itself might be used as an integrator of the effects of the weather 
that had occurred up to the date of the observations (Yates, 1936). 

This series of observations also gave rise to some interesting inves¬ 
tigations into the types of bias that arise from faulty methods of selec¬ 
tion in work of this type—investigations which have been of consider¬ 
able importance in connection with the estimation of the yields of crops 
from small samples at harvest (Yates and Watson, 1934; Yates, 
1935). 


Efficiency of Sampling 

In the early investigations into the sampling error of agricultural 
field experiments, no formal study of the eiB&ciency of the sampling re¬ 
lative to the accuracy of the experiment as a whole was made. By 
1935, however, a considerable volume of results of actual sampling of 
cereals experiments had been accumulated and these served as the basis 
of investigation into this subject (Yates and Zacopana y, 1935). 
It was recognized that the governing factors are the ratio of the samp¬ 
ling to the experimental error per plot and the ratio of the incremental 
cost of sampling to other experimental work. Knowing the sampling 
and experimental errors per plot, the degree of replication required to 
attain a given accuracy in the final results with any given intensity of 
sampling per plot can be determined. The minimization of the corres¬ 
ponding cost function serves to determine the optimal amount of sam¬ 
pling under given cost and labor conditions, and also to determine under 
what circumstances sampling of such experiments is preferable to full 
harvesting. It is interesting to note that this investigation led to a 
reversion to full harvesting in circumstances in which sampling had pre¬ 
viously been employed, and also to the investigation of an alternative 
method of sampling, namely* sampling for the ratio of grain to total 
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produce, the latter being weighed in toto for each plot—an excellent 
illustration of the importance of investigating the efficiency of samp- 
ling processes. 

A later and more elaborate investigation of the eflSciency of samp¬ 
ling was undertaken by Mahalanobis (1944) in connection with 
the development of sampling methods for estimating crop acreages and 
yields in India. Mahalanobis determined a general law of variability 
of the material sampled, similar to that determined independently by 
Fairfield Smith (1938) for the variation in fertility of experi¬ 
mental areas in an investigation into the optimal size of plot for agri¬ 
cultural experiments. On the basis of this law of variability and a 
careful costing of the actual processes of sampling and statistical reduc¬ 
tion of the results, Mahalanobis determined a cost function the mini¬ 
mization of which gave him a basis for determining the optimal distri¬ 
bution of his sampling units*. 

Use op Ancillary Information Concerning the Population 

Sampling for yield by the determination of the grain/total-produce 
ratio introduced a further problem of considerable theoretical interest, 
and also of great practical importance in the sampling of economic and 
sociological material. . This is the problem of the estimation of the mean 
or total of the population, and the corresponding sampling errors, from 
a ratio determination (here the grain/total-produce ratio) by sampling, 
in conjunction with some ancillary measurement known for the whole 
population (here total produce). 

If the grain/total-produce ratio is calculated separately for each sample, 
and the mean of these ratios is taken, the estimation of the sampling 
error of this mean ratio can be determined in the manner adopted for 
direct sampling for yield. The estimate of the yield of grain on a plot 
given by the product of the mean ratio and the yield of total produce 
may, however, be biased. If, for example, areas with a high yield of 
total produce also on the average have a high grain/total-produce ratio, 
an underestimate of the yield will be obtained. This bias can be 
avoided if the yields of grain and total produce are summed separately 
for all the sampling units of a plot and the ratio of these totals is used 
to determine the yield of grain. Symbolically the ratio is estimated 

from %ylXx instead of variance of the ratio of 

the totals can be calculated from the variances and covariance of x and 
y. This problem was discussed by Cochran (1940), who also gave a second 
approximation to the variance of such a ratio. 

.Ancillary information of the above type can be used in another way. 
The regression of the observed variate y^on the ancillary variate x can 
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be determined, and a correction can be applied to the mean value of 
the observed variate in the sample to allow for the difference between 
the mean of the ancillary variate in the sample and in the population. 
Symbolically the corrected estimate is given by 

Y^y-b(x-X) 

The use of the ratio method is equivalent to taking a value of b equal 
to yjx instead of determining from the observations themselves the va¬ 
lue of b which will give the most-accurate estimate. An application in 
the British Census of Woodlands to the estimation of standing timber 
from actual measurements of a sample of stands, and eye estimates of 
all stands, is described by Cochran (1939). 

Here again developments in the theory of regression analysis in the 
biological field contributed to the correct solution of the problem. In 
particular, the analysis of covariance, first developed as an extension of 
the analysis of variance in order to adjust the results of replicated ex¬ 
periments for ancillary information, such as plant number, gave the 
appropriate method of estimating b in stratified samples. 

Another interesting application of regression analysis was developed 
by B o y d (1947) in connection with the use of eye estimates for crop 
estimation. (Ihe work was actually carried out in 1940 and 1941.) 
In order to correct for the inevitable bias in the eye estimates, a?, (taken 
on a random sample of fields), he obtained subsequent information on 
the harvested yields, y, of a subsample of these fields. This sub¬ 
sample, however, was not random, being conditioned by the availabi¬ 
lity of the information. In this case an unbiased estimate of the yield 
is given by 

Y = y-^(x- X) 

where y and x refer to the subsample and X to the full sample and 6' 
is the regression of x and y. 

Purposive Selection and Quota Sampling 

Purposive selection—^that is the selection of the sample in such a 
manner that certain known quantitative characteristics of the popula¬ 
tion are reproduced in the sample—and its modern variant, quota samp¬ 
ling, introduce a number of interesting theoretical problems. In the 
memorandum on sampling prepared by a Commission of the Interna¬ 
tional Statistical Institute (1926) purposive selection figured largely 
but there was no discussion of the question of what methods of selec¬ 
tion might be used to obtain Samples having the required values of the 
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knbwii quantitative characteristics without distortion of the other 6ha- 
racteristics of the population. In these circumstances it was not sur¬ 
prising that purposive selection led to some bad failures, and the method 
was severely criticized by Neyman (1934). The Fisherian School, 
conscious of the simplification introduced into statistical deductions from 
the results of experiments by the proper use of randomization, also did 
not favor the method, either in sampling or in the analogous situation 
in experimental design, in which the plots or animals assigned to the 
different treatments could be balanced for some known quantitative 
characteristic such as preliminary yield or initial weight. They pointed 
out that if the sample was otherwise random the sampling or experi¬ 
mental errors could be estimated by the use of covariance analysis, but 
that results of equal precision would be obtained from ordinary random 
samples adjusted by the covariance procedure. 

Nevertheless, provided proper methods of selection can be evolved, 
the use of a balanced sample has an advantage in that no adjustment 
of the sample means by regression is necessary. This is important in 
the sampling of economic and sociological material, particularly when 
large numbers of variates are involved, when mechanical computing me¬ 
thods of the punched card type are employed, and when repeated samp¬ 
lings of the same material have to be made. 

In my review before the Royal Statistical Society (1946), 1 suggested 
the procedure of random selection with replacement, if the balance was 
thereby improved, of members of the original sample successively by 
further randomly selected members. The theoretical points involved 
were discussed by Anscombe and Quenouille (1946), and 
Quenouille has subsequently undertaken further work on the problem 
which will be published shortly. 

Sampling Units and Strata of Dipfkrino Size and Vabtability 

In most of the early sampling problems encountered in agricultural 
and biological research sampling units of approximately equal size and 
variability could be employed. In economic and sociological material, 
however, the natural sampling units often vary widely in size, c.^., house¬ 
holds in surveys of human populations, farms in agricultural economic 
surveys. In such cases, the variability is also not constant, being related 
to size and other characteristics of the sampling units. The methods 
appropriate to sampling strata and units of equal size and variability 
require considerable extension and modification before they can be 
really useful for economic and sociological material. 

This work has made active progress on both sides of the Atlantic 
during and subsequent to the war (Cochran 1940, 1942; Hansen and 
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Hurwitz, 1943; Yat^, 1946). Hansen and Hurwitz, in particular, 
have considered the problem of sampling stratified populations in which 
6ach stratum contains a small number of primary sampling units of 
large and varying size. By sampling the primary units within each 
stratum with probabilities proportional to the sizes of these primary 
units, and subsampling within the primary units with probabilities so 
chosen that the over-all probability of selection of a secondary unit is 
constant for all primary units and all strata, they ensure that the ordi¬ 
nary estimate of the ratio provided by Xy/Xx is both unbiased and free 
from variability due to variations in size of primary units within strata.^ 

On the agricultural side, graphical methods have been developed, in 
the course of sampling of agricultural fields for wire worm infestation, 
in order to provide estimates of sampling error when the variability de¬ 
pends on some property of the sample such as the mean. This is appli¬ 
cable to cases in which the number of degrees of freedom available for 
the estimation of error is too few for accurate estimation of the sampling 
error of each sample separately and is analogous to the pooling of esti¬ 
mates of error in the analysis of variance when equal variability can be 
assumed (Finney, 1941; Yates and Finney, 1942). 

Use of a Vabiablb Sampling Fraction 

The possibility ofvarying the intensity ofsampling when differing degrees 
of accuracy are required on different parts of the material is so self- 
evident as scarcely to require formalization. The conscious use of such 
variation of intensity in order to obtain the most accurate over-all values, 
on the other hand, is relatively recent. The subject was thoroughly 
discussed by Neyman (1934) and Sukhatme (1935). Neyman 
pointed out that for maximum precision on the population values, the 
sampling fractions of the different strata should be chosen proportional 
to the within-strata standard deviations of the sampling units: 

fi „ /2 _ /a _ 

^2 <^.3 

Neyman, however, proposed that the values of the cr, usually unknown, 
should be determined by preliminary sampling. This made the whole 
method cumbersome and consequently of limited practical utility. 

Fortunately in economic material, in which the use of a variable samp¬ 
ling fraction is of most value, the variability is usually a function of 

I I regret that in my reply to the discussion on my 1946 paper I failed to recog¬ 
nize the importance and originality of this contribution. I am glad to have this 
opportunity of correcting my error. 
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some other characteristic of the material which is known or can be ascer¬ 
tained in advance, and which can be used as a basis of stratification. 
Very frequently, in particular, the standard deviation is approximately 
proportional to the size of the unit concerned, and stratification by size, 
with sampling fractions approximately proportional to the mean size of 
each size group, leads to very great gains in efficiency. This procedure was 
used, for example, in the analysis (carried out in 1943-44) of the National 
Farm Survey of England and Wales (1946). In order to give adequate 
representation of the smallest size group, and to give somewhat in¬ 
creased precision on statistics of number of farms, the sampling frac¬ 
tions chosen were not quite proportional to mean size. Nevertheless 
in statistics involving area, which were the 'main concern of the analysis, 
there was a gain in precision of three and a half times that which would 
have been obtained by use of a constant sampling fraction. 


Systematic Sampling 

In the sampling of material which is distributed either temporally or 
spacially in one or more dimensions, it is frequently simpler to take samp¬ 
ling units at equal intervals (either of time or space), than to locate each 
sampling unit at random. It was early perceived that in material subr 
ject to a more or less continuous type of variation, such sampling (called 
systematic sampling) was likely to be more accurate than stratified ran¬ 
dom sampling of the same intensity. The diagrammatic representation 
of such material, by graphs or maps, is also improved. 

By abandonment of the principle of randomization, however, the whole 
theoretical basis of the estimation of sampling error is destroyed, just 
as in replicated experiments lack of randomization prevents a valid 
estimate of experimental error or valid tests of significance. 

In experimental work there C8^ be little question that the slight gains 
in precision and convenience resulting from certain types of systematic 
design are not sufficient to compensate for the loss of valid estimates of 
error and other advantages accruing from randomization, and the need 
for randomization is now almost universally accepted (Yates, 1939). In 
sampling, however, the issue is not so clear-cut, and there is therefore 
a case for investigating how far it is possible to estimate the sampling 
errors in systematic sampling, and what are the appropriate methods. 
Such investigations have been proceeding in recent years, both in Ame¬ 
rica (see in particular, Cochran, 1946) and Great Britain (Yates, 1946). 
A full account of my own investigation has not yet been published,* 
but certain conclusions may be briefly summarized here. Firstly, if the 
material is such that there is any periodicity, either of the true periodiq 


♦ Now published (Yates, 1948) 
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or autoregressive type, systematic sampling is obviously dangerous and 
must be avoided. Secondly,-though it is relatively easy to determine 
upper limits to the sampling errorp (except in material subject to perio¬ 
dicities) such upper limits are liable to be considerably in excess of the 
true sampling errors, which can only be determined with certainty by 
rather extensive supplementary sampling, and, thirdly, that the use of 
certain simple end corrections to eliminate the effects of trend can be 
of considerable importance. 


Resume 

Le developpement de la thSorie des Bondages au cours des vingt-cinq 
derniires ann6es a ^t6 ^troitement associe k la recherche statistique 
agronomique. La pr^sente communication expose les fruits de cette 
association (k Texclusion des d^veloppements recents aux Etats-Unis, 
trait6s par le Professeur Cochran) et d6crit leur relation avec la th^orie 
des Bondages dans les domaines 6conomique et sociologique. 

Les contributions principales k la theorie, qui g6n6ralement ont result© 
de le soluion de problemes pratiques, ont 6te les suivantes: 

1. Effetde restrictions sur le choix au hasard, les unites de sondage 
complexes^ les sondages d'ordre multiple. 

La theorie du plan d’exp^riences et Tanalyse de la variance ont rendu 
plus clair le role de Tel^ment al6atoire dans les Bondages. II a 6te re- 
connu que Terreur d’echantillonnage ne pouvait etre estimee avec certi¬ 
tude, et que I’absence complete d’erreurs syst^matiquqs dans les nioyen- 
nes empiriques ne pouvait etre assur4e, que lorsque quelque element 
. de hasard intervient dans le choix, mais que maints types de restrictions 
^taient possibles dans ce cadre. L'usage d’unites de sondage complexes 
et la m6thode des sondages d’ordre multiple (sub-sampling), 6tait convert 
par la theorie qui, cependant, n’avait ete initialement d6velopp6e que 
pour traiter des unites de sondage de dimension et de variability approxi 
mativement ygales. L’analyse de la variance fournissait des methodes 
appropri6es pour I’estimation de I’erreur d’ychantillonnage dans de tela 
cas (Clapham, Wishart et autres). 

2. EffieacUe, ' 

Les lois qui gouvernent Tintensity de I’ychantillonnage requis© en 
vue d'un© efficacity maximum du travail expyrimental furent dyterminyes. 
©n s© ryfyrant spycialement aux relations entre le coUt du travail d’y- 
phf^ntiUonnage ©t du travail compiymentair© (Yates). L’idy© d© la 
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minimisation du cotit et de Tusage d’une loi g6n6ralisee de variabilite 
pour le sondage spatial a 6t6 d6velopp6e en rapport avec les essais 
d’estimation de r^colte (Mahalanobis). 

3. Usage de renseignements accessoires concernant la population. 

Dans maints cas des donn^es au sujet de certaines variables al6atoires 

sont connues exactement (d’aprfea les donn6es de recensements, etc.) 
pour Tensemble de la population soumise au sondage, des renseignements 
sur d’autres variables devant 4tre determines par echantillonnage. Les 
valeurs theoriques de ces autres variables peuvent alors etre determinees 
soit par I’usage de rapports (ou pourcentages) soit k Taide de la regres¬ 
sion (analyse de la covariance). Lesmethodes appropriees d’estimation 
et les erreurs d’echantillonnage qui leur sont associees ont ete determindes 
(Cochran et autres). 

4. Choix raisonne et echantillonnage par qiu)tas. 

La theorie du controle d^un caractfere quantitatif en adaptant Techan- 
tillon par rapport k la variable accessoire a ete etudi^e, et des methodes 
de selection qui echappent aux objections qu’on peut soulever au choix 
raisonne et k 1*echantillonnage par quotas tels qu’ils sont generalement 
appliques ont ete proposees (Yates et autres). 

5. Unites de sondage de dimensions et variabilite differentes. 

La fa^on de traiter des unites de sondage de dimensions differentes 
a ete rendue plus claire. Des methodes graphiques d^e.stimation de 
Terreur ont ete developpees pour etre utilisees dans les cas oh la variabi¬ 
lite depend de quelque autre propriete de Techantillon, par exemple 
de Ja moyenne (Finney). 

6. Usage d'une fraction variable d'echantillonnage. ' 

Dans plusieurs cas, dans le domaine economique en particulier, 
I’efficacite de Techantillonnage est considerablement accrue par Tusage 
d’une fraction variable d’echantillonnage. La theorie sous-jacente h 
son usage a ete developpee, et sa valeur demontree en pratique ( Neyman, 
Sukhatme, Yates.) 

7. Echantillonnage syst^matique. 

Les problfemes que posent I’estimation des recoltes et les releves fore- 
stiers ont donne lieu k des recherches etendues dans le domaine de la 
theorie des sondages systematiques. Une grande partie de ces recher¬ 
ches n’a pas encore ete publiee (Cochran, Yates, Quenouille et autres). 
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RECENT DEVELOPMENtS IN SAMPLInC 
THEORY IN THE UNITED STATES 

by W. G. Cochran 

Univermty' of North Carolina {United States) 

1. Introduction 

In this country the investigation of the theory of sample surveys is 
of recent origin. The increased use of sampling methods during the 
late thirties by public opinion polls, market research agencies, and govern¬ 
ment bureaus took place with relatively little reliance on the services 
of the mathematical statistician and did not at first give rise to exten¬ 
sions of the underlying theory. Thus the period under review, from 
about 1939 onwards, contains practically all the development in theory 
that has occurred here. Discoveries in theory during the period have 
already profoundly influenced sampling practice and have resulted 
in an appreciation of the utility of theoretical investigations. These 
consequences are due largely to the fact that the small group of persons 
responsible for the developments in theory are also either actively en¬ 
gaged in the taking of sample surveys, or are closely connected with 
this work. 


2- General Trends in Research 

The chief guiding principle in current research work is that the ob¬ 
ject in taking a sample is to obtain estimates of maximum accuracy for 
a given cost of taking the sample, or alternatively to obtain estimates 
with a specified degree of accuracy for minimum cost. Since in practice 
sample estimates can usually be regarded as approximately normally 
distributed, maximum accuracy is identified with minimum error vari¬ 
ance in the sample estimate. The principle is not new: it has been 
used, for instance, by Yates and Zacopanay (1935) and by 
N e y m a n (1938). Nevertheless, its implications were not at first rea¬ 
lized either by the practical sampler or by the statistician. The former 
was inclined to aim at getting the largest size of a sample for a given cost, 
without appreciating fully that a large sample is itself no guarantee 
of accuracy. The statistician, on the other hand, tended to base his re¬ 
commendations on considerations of accuracy alone, perhaps from a 
reluctance to become involved in cost accountancy. Indeed, knowledge 
of the relative costs of different sampling methods still lags behind 
knowledge of their relative accuracies, though a beginning has been made. 
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If accuracy alone is taken into account, sampling units that are small 
and widely scattered very frequently appear to be best. A computation 
of costs may show, however, that a larger sampling unit gives equal accu¬ 
racy more cheaply, while if subsampling is used, quite large units may 
be economical. Investigations on optimum size of unit will be reported 
later (section 6). 

The principle has also brought out the importance of careful planning 
of a sample. In order to apply the principle one must know, before 
the sample is taken, the costs of the methods of sampling under con¬ 
sideration, the methods of estimation that will subsequently be used, 
and the sampling variances of the resulting estimates: These facts 
will not all be known exactly, but serviceable estimates of them can often 
be made from the results of previous survej’^s. This approach has led to 
research on cost functions (sections 5.2, 5.5, 6.2, 7.2), on the properties of 
diiferent methods of estimation (section 4), and on sampling error for¬ 
mulae for more complex types of sampling (section 5.3,7.1). Attempts have 
also been made to obtain error formulae for techniques such as syste¬ 
matic sampling (section 8) which though intuitively attractive have not 
as yet proved amenable to a treatment by standard statistical methods. 

It is known that no valid sampling error formula exists unless .the 
selection of the sample is to a certain extent determined by the laws of 
probability through the use of an objective method of randomization. 
Such random selection cannot be achieved without something equi¬ 
valent to a listing of the sampling units in the population. This fact 
often imposes a serious obstacle to the use of theoretically sound sampling 
methods, particularly with human populations; where usually no list¬ 
ings arc available. The method of area sampling represents a major 
achievement towards overcoming this difficulty. The sampling unit 
is a compact area of land, A listing of the units in the population is 
obtained by constructing these areas so that they completely cover, a 
map that shows the population to be sampled. In the Master Sample 
of Agriculture, designed primarily for farm surveys (King and - 
J e s s e n, 1945), every county in the United States was divided in this 
way into areas. The areal sampling units average about 2J square miles 
and contain from 4 to 8 farms on the average. Important administra* 
tive problems were to devise a rule so that every farm “belongs” to one 
and only one area, and to provide interviewers with aids (e,g., aerial 
photographs) to the correct identification of the boundaries of the areas. 
In large towns the unit is usually a city block, which can also be out¬ 
lined on a map (for discussion see Hansen and Hauser, 1945). 
While detailed accounts of the method will not be given, some research 
involving area sampling is presented in saetions 6 (for rural surveys) 
and 7 (for urban surveys), s 
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^ .In. tHe presentation which follows, I have tried to select the easiest 
^ order, for the various topics, rather than a chronological order or one of 
presumed importance. Further, one cannot help being struck by the 
Isimilarity to developments in India arid Bntain, w^hich have been re- 
^pOrted by Mahal a n obis (1944) and Yates (1946). For this reason 
I have not in general attempted to assign priority of discovery, especially 
’ iiumerous methods >nd results A^ere kriowii for sOihe time before 
publiccLtion. In order to maintain a reasonably uniform notation in this 
’^aper, I have often, when writing about some result, had to change the 
'hbityi^tion in which the author originally presented it. This will, be an 
^ aSteoyaiice to the reader who wishes to study the original, but haS seemed 
' unavoidable, since sampling literature is noted for the high variance 
^hi its nbfation. A population variance cr* has been defined as the sum 
of squibres of deviations divided by (A’—1), where N is the number of 
"Siiits in the population. This will change slightly the appearance of 
^formulae in cases where the author has used a divisor N. 


3. Extension of the Geneuat. Principle 


’On further examination, the principle of maximum accuracy for given 

1 cost or minimum cost for given accuracy, is not itself completely satis- 
' factory. The principle assumes that in some way either the cost or 
.!the accuracy is fixed in advance. Now the specification of the desired 
.degree of accuracy usually involves some arbitrariness. If a coeffi- 
, .cibnt of variation of 1.5 percent is demanded, the sample will not be re- 

2 garded as useless should the coefficient turn out to be 1.6 percent. The 
..advance specification of a sum of money that must be spent on the 
^shmple i^ also open to criticism; for the accuracy obtained from this ex¬ 
penditure may be substantially more, or substantially less, than is needed 

r.for the use that is to be made of the estimates. Two attempts to uti- 
.:li*e a more general principle,' in which optimum cost and optimum 
• accuracy are determined simultaneously, deserve notice. 

I . Im order to apply the principle, one must be able to answer the ques- 
r tion; how much is a given degree of accuracy worth?. Any decisions 
r that are based on an estimate from a sample will presumably be more 
. fruitful if the estimate has a low error than if it has a high error. In 
(certaiii cases we may be able to calculate, in monetary terms, the loss 
l l(s) that Will be incurred in a decision through an error of amount z in 
jthe estimate. Although the actual value of z is not predictable' in 
.-advance, sampling theory may enable us to predict the frequency 
, (distribution p(z,n) of «, which for a specified method of sampling will 
/depend on the size of sample n. Hence, the expected,\o&s for a given 
s4»mple ia. . . • : . : > 

L(n) ^ jl{z)p{z, n)dzy, j ; - 
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The purpose in taking the sample is to diminish this loss. If Cjin) 
is the cost of a sample of size n, clearly n should be chosen so as to mini¬ 
mize 

C(n) j- L(n) 

since this is the total cost involved in taking the sample and in mailing 
decisions from its results. Choice of n so as to minimize this quantity 
will determine both the optimum amount of money to be spent on sanip- 
ling and the optimum accuracy. The idea is presented here only in its 
simplest form: it may be extended to cover a choice between differeiit 
sampling methods. 

In the application described by Bly the (1945), the selling price 
of a lot of standing timber is SV, where S is the price per unit volume, 
and V is the volume of timber in the lot. The number N of logs in 
the lot is counted, and the average volume per log is estimated from 
a sample of n logs. If or is the standard deviation per log for the samp¬ 
ling method used, the standard deviation of the estimate of V will 
be Naly/n (ignoring finite population correction). 

Suppose that this estimate is made and paid for by the seller. The 
buyer provisionally accepts the estimate of the amount of timber which 
he has bought. Subsequently, however, he finds out the correct volume 
purchased, and the seller reimburses him if he has paid for more than 
was delivered. If he has paid for less than was delivered, the buyer 
does not mention the fact. In this situation the seller loses whenever 
he underestimates the volume, but does not gain when he overestimates 
it. The situation is artificial (my presentation is slightly different from 
that of Blythe). My purpose is simply to illustrate the application of 
the principle to a case that does not require complex mathematics. 

When he underestimates the volume by an amount z, the seller loses 
an amount 8z, Thus we may take l(z) as zero when z is negative and 
as 8z when z is positive, where z is the amount of underestimation. On 
the assumption of normal distribution of sampling errors, p(z,n) is the 
normal distribution with mean zero and variance Hence 

nz- 

y/2n N<t v2Tr» 

If we suppose further that the cost of measuring the volume of a log is fc, 
the cost function G{n) is cn. The quantity to be minimized is therefore 
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Differentiation with respect to n leads to the solution 



In the example due to N o r d i n (1944), a manufacturer takes a sample 
in order to estimate the size of a market which he intends to enter. If 
the size, is known accurately, the amount of fixed equipment and the 
production per unit period can he adjusted so as to maximize expected 
profit. Errors in the estimated size of market will result in choices 
of ^hese two factors that fall short of the optimum, and lead to smaller 
expected profit. The sample size n should therefore be such that 
the addition of an (ii+llth unit to the sample increases the profit 
expectation by exactly the cost of the (nfl)th unit. 

In many cases it will be difficult to apply these ideas because no way 
can be found to translate the effect of a sampling error into monetary 
terms. Moreover, an estimate may be used by different persons for 
quite diverse purposes. Nevertheless, the question of the standard 
of accuracy needed in sample estimates has received too little attention 
and this type of research points in a fruitful direction. 


4. Estimatio.v op a PoriJi.ATioN Total 

Bather naturally, persons engaged in sampling have favored methods 
of estimation that can be computed easily and rapidly. • The poten¬ 
tialities of complex methods of estimation have been little explored. 
The gain in accuracy from a superior method of estimation may, how¬ 
ever, often be secured fairly cheaply, since only the final computations 
are. affected, and there are likely to be cases, with important estimates, 
where quite elaborate calculations would be justified if a substantial in¬ 
crease in accuracy resulted. In this section some sampling properties 
of two methods of estimation, the ratio and the linear regression methods, 
are presented. Both have been in use for some time; the circumstances 
favorable to each are now, however, better understood. For simplicity, 
the properties are given only for a purely random sample (that is, a 
sample drawn so that every group of n distinct units in the population 
has an equal chance of being the sample). 

Probably the most common method for estimating the population 
total Fj, of some item y is to multiply the sample total F, by the inverse 
Njn of the sampling ratio. This estimate may be described as the 
mean per sm, estimate. Its variance is 


Fn/p ^ 


N{ N-n)ary^ 


( 1 ). 


n 
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In the other two methods an auxiliary variate x, correlated with^y, 
must be obtained for each unit in the sample. In addition, the popula¬ 
tion total Xp of X must be known. In practice, x is often the value 
of y on some previous occasion on which a complete census was taken. 
The aim in both methods is to obtain increased accuracy by taking 
advantage of the correlation between y and x, 

4,1, The ratio estimate. This estimate, which is simple to compute, 
is 



This estimate is, in the technical sense, a *‘best unbiased linear estimate” 
if two conditions are satisfied: (i) the relation between y and a: is a 
straight line through the origin, and (ii) the variance of y about this 
line is proportional to x (Cochran, 1942). In exploratory work, a graph 
plotting the sample values of y against x is therefore useful in consider¬ 
ing whether the ratio estimate is likely to be the best available. 

Where these conditions are not satisfied, the distribution of the ratio 
estimate in small samples has not yet been expressed in convenient 
terms, despite numerous attempts. Unless condition (i) holds, the 
estimate is biased (H a s e 1, 1942), though the bias is usually negligible 
relative to the sampling error. In large samples the distribution tends to 
normality with a variance which is approximately 

(2) + /V a,* - 2 ] 


where lip—YJXp is the population ratio of y to x, and p is the corre¬ 
lation coefficient between y and x. 

On comparison with (1) it is found that the ratio estiniato has a smaller 
variance than the mean per s.u. estimate if 


P> \ 


Hy l ic.v.h 

(Ty ^ {c.v.)y 


where c,v. denotes coefficient of variation. Thus the success of the ratio 
method depends not only on the size of the correlation coefficient, but 
also on the c.v. values. In fact, if the c.v. of x is more than twice that 
of y, the ratio estimate always has a higher variance than the mean per 
s.u. If X is the value of y on some previous occasion, the two c.v.^s may 
be about equal. In this case the ratio estimate is superior if p exceeds 
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4,2, Tf^ linear regression estimate. We first compute from the sample 
the least squares estimate b of the linear regression of y on x. The 
estimate of is then taken as 

( 3 ) N{y^ +- 

where i^8» sample means and is the population mean of x. Like the 
ratio estimate, this estimate is slightly biased, though the bias is 
unimportant. For samples that are reasonably large, the variance 
may be taken as 

(4) Vu. - 

n 

The error in this formula^ which arises from neglect of the sampling 
variance of 6, is in relative terms about 1/n. The expression has been 
shown to remain valid in large samples even if the true relation is not 
linear or if the variance of y changes with x (Cochran, 1942). 

From equations (1) and (4) it is clear that in large samples the regres¬ 
sion estimate is always more accurate than the mean per s.u. estimate, 
except when p is zero. Comparison of (4) with (2) shows, after a 
little manipulation, that the regression estimate always has a smaller 
variance than the ratio estimate unless 

( 6 ) p 

^ (T, (C.V.), 

in which case the two have equal variances.^ Equation (5) holds when¬ 
ever the relation between y and a; is a straight line through the origin, 
so that in this event the regression and ratio estimates are equally accu¬ 
rate. The fact that the regression estimate is as good as the ratio 
estimate even when the latter is a best unbiased linear estimatei is 
interesting. 

The regression estimate is more laborious to compute, principally 
owing to the work in calculating 6. However, if there is an appreciable 
saving in time, an inefficient estimate of h can be used instead of the least 
squares estimate. If the estimate of h has efficiency E, (jE^<l), the 
fractional increase in the variance of the regression estimate of is 
about (l—i^)/n-&. With large n, even a highly inefficient estimate of 6 
causes only a trivial increase in the variance. It should, however, be 
remembered that with the least squares 6, one can get an unbiased 
sample estimate of cry*(l—p*) very quickly, whereas with other 
estimates of b the “short-cuf calculation of the sample residual mean 
square does not apply. 

• 

* This result was first brought to my attention by Mr. J, R. Qooclmaxv. 
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'''Another type Of estimate has been used by Jessen et ah (1947) 
in a survey taken to estimate the population of Greece. The relation 
of y to a? was found to be a straight line through the origin, but the vari¬ 
ance of y about the line Was proportional to rather than to x. The 
best estimate of in this case is where fp is the arithmetic mean 

of the sample values of yjx. Some discussion of the properties of 
weighted regressions has been given by Hasel (1942) and Cochran (1942). 

5. Stratified Random Sampling 

In stratified random sampling the population is divided into a number 
of groups or strata, the object being to have little within-group variation 
in the items to be estimated. The total number of sampling units in 
the Ath group is assumed known, and a random sample of is selected 
frorn the group. The principles governing stratified sampling have become 
familiar through the work of Neyman (1934) and the device is almost 
ilniversally applied. While no major developments have occurred in 
jbhe period under review, a number of useful results will be given. 

5.1. Deep stratification. The number of strata is limited by the 
size of sample, since there must be at least one sampling unit in each 
stratum. It may happen that the size of sample must be jcept small 
for administrative reasons, but that mi^ny useful criteria for stratification 
are available. A method of taking advantage of the criteria with an 
incomplete stratification has been mentioned by F r a n k e 1 and 
Stock (1942, p. 80). 

The sample was taken as part of a monthly survey of unemploy¬ 
ment. The population with which we are concerned contains the 447 
“urban” counties in the United States. These were divided into three 
,strata according] to county population (low, ipedium, high). Each 
stratum was further stratified into three groups by geographic loca¬ 
tion of the counties (NE, SE, and W), and each of the nine cells was 
still further stratified by the 1937 percentage of unemployment (low^ 
medium, high). Thus there were 27 strata, which might be shown as 
follows: 


Location 

C( 

Low 

lunty Populatio] 

Medium 

High 

ne 

1, m, 

, 1, m, h 

1, m, h 

■■■■ SE 

1, m, h 

1, m, h 

1, m, h 

. w . . . . 

l,m,h 

1, m,b . . 

—• - 

. 1, mi h-* 


1957 % unemployed*, low (1), medium (m), high (h). 
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Suppose that only nine strata are chosen, following the latin square 
•plan below: 


3X3 LATIN SQUABE 



L 

M 

H 

NE 

1 

m 

h 

SE 

m 

h 

1 

W 

h 

1 

in 


For instance, from the three strata which have low county population 
and NE location, we select only the stratum with low 1937 percent 
unemployed (1), and so on. Given the sample means in the nine select¬ 
ed cells, we can estimate from the columns of the square, the average 
difference between counties with low, mediumr and high population, 
from the rows the average difference between counties with NE, SE, and 
W locations; and similarly from the letters in the square, the average 
differences caused by the third classification. If these differences are 
assumed to be additive, the stratum means for all 27 cells can be esti¬ 
mated. By use of a 3x3 Graeco-latin square, a fourth classification 
could have been added, giving a representation of 81 strata by only 
nine cells. 

Not enough research has yet been conducted on this method to permit 
a verdict on its utility. The method will obviously be most successful 
when each classification shows large effects that are independent of 
those of other classifications. A test of the method in a survey of the 
city of Wilmington was made by Topping, Hurwitz, and 
D e m i n g (1943). They compare four methods of deep stratification 
'with ordinary stratified sampling and with random sampling. The 
results were, however, inconclusive. 

. d.2. Optimum allocation with varying costs. If yh* i<9 the sample mean 
in the ^h stratum, the '*mean per s.u.’’ estimate of the population total 
is summed over the strata. For a given total size of sample, 

Neyman (1934) has shown that this estimate has minimum variance 
if the sample sizes nn are chosen proportional to where cTh* is 

the'varianice in the stratum. This well-known principle has often re¬ 
sulted in • marked increases in accuracy over proportional sampling, 
particularly in sampling business enterprises, where the variance may 
be immensely greater for large than for small firms. 

ttywe apply the general principle of minimum variance for given to¬ 
tal eostf the Neyman method of allocation is optimum only when the 
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cost per unit is the same in all strata. The best allocation can be worked 
out for any particular case when the cost function has been obtained 
in terms of the Wh. A useful result that is easily remembered occurs 
when the total cost is of the form That is, the cost per unit 

varies from stratum to stratum, but within each stratum costs are pro¬ 
portional to the size of sample. 

The variance of the estimate is 

2 ’ N^{Nu-n^) ^2 

o-,. 


and this is to be minimized subject to the restriction that SChn^ is fixed. 
Minimum variance will be found to be obtained when % is proportional 
to iV^h^h/V^h* would be expected, the effect is to diminish the 
amount of sampling from costly strata. 

6,3, Stratified sampling with ratio estimates. There are several ways 
in which a ratio estimate of a population total can be made. One is 
to make a separate ratio estimate of the total of each stratum, and add 
these totals. If Fug» ^hs are the sample totals in the Ath stratum, 
and Xbp is the stratum total for x, this estimate is 



■' Y 
Y 

-Alls 


It is clear that no assumption is made that the true ratio remains fixed 
from stratum to stratum: the estimate postulates, however, a know¬ 
ledge of the separate Xi,p. 

Since sampling is independent in the different strata, the variance 
is found simply by summation of terms as given in formula (2). 

(7) y 

W|, V J 

where /2hp= I^hp/^hp is the true ratio for the stratum. 

An alternative estimate, derived from a single pooled ratio, has been 
used by Hansen, Hurwitz and Gurney (1946). This is 



7 
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Note that only the population total of the x'b need be known. The. 
variance of this estimate works out as 


( 8 ) 


V 

pooled 


=2 


«h 


«h) 




<^h** — 2 i?p /)„ Vhy ?h 


This differs .from (7) only in that the single ratio Itj,= YplXp replaces 
the i?hp. In order to compare (7) with (8), we may use the result (loc. 
cit. p. 179, footnote) that (8) can be written 

(9) r = F 

pooled sep. 

• ‘'hx® + 2(V?„p-/?p)(p„ trV)} 

The last tetm on the right is usually small (it vanishes if within each 
stratum the relation between y and x is a straight line through the ori¬ 
gin). It follows that unless i?hp is constant from stratum to stratum, 
the use of a separate ratio estimate in each stratum is more accurate. 
The advantage appears to be small, however, unless the variation in the 
jRhp is violent. 

For sample estimates of (7) or (8), we substitute the sample estimates 
of i?hp or JBp in the appropriate places. The sample mean squares 

are substituted for the corresponding variances and the sample 
mean covariance for the term Ph^hy<^hx- It will be noted that in general 
the sample mean squares and covariance must be calculated separately 
for each stratum. 

The optimum allocation of the Wh may be different when a ratio es¬ 
timate is used than when a mean per s. u. is used. In discussing this 
point, we shall use (7), on the assumption that in practice (7) and (8) 
will differ little. Now the quantity inside the bracket in (7) is the va¬ 
riance within the Mh stratum of the variate d = This va¬ 

riance will be called (Thd*. If (7) is minimized subject to a total cost 
of the form SChnn, it is found that the must be chosen proportional 
to whereas with a mean per s. u. estimate, Wh is^ chosen 

proportional to 

In the case where the ratio estimate is a best unbiased linear estimate, 
(Thd will be proportional to \/x. The would then be made proportional 
to iV’hV^hp/\/Cii» where a:i,p is the stratum mean of x.'In other cases, e.g. 
that of estimating retail store sales discussed by Hansen, Hurwitz, and 
Gurney (loc. cit,), the variance of d may be more nearly proportional to 
This leads to the allocation njjoc Xhp/-\/Ch, where is the stratum 
total of X, . 
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&A, Effects of errors in the strata totals. It frequently happens in prac¬ 
tice that for some desirable type of stratification the strata totals 
are not known exactly, being perhaps derived from a population count 
that is out of date, or from another sample. Definite statements about 
the consequences of basing a stratification upon erroneous weights can¬ 
not bo made without getting down to particular cases. A few conclu¬ 
sions of a general nature cr.n, however, be drawn. 

For simplicity, we consider only the estimation of the population 
mean per unit: finite population corrections will be ignored and the 
cost per unit is assumed the same in all strata. If the were known, 
% would be chosen equal to nNi^cru / The sample estimate of 

the population mean would be which may be written 

SlThyha- Its variance (which may be obtained from formula (6)) sim¬ 
plifies to 


Instead of the true stratum proportions W^y we have estimates. u?h. 
The sample estimated mean is yhs- The first point to note is that 
this estimate is biased. Its mean value in repeated sampling is 
while the true population mean is Slfh^hp- The bias amounts to 
Consequently, the error variance of this estimate contains 
two components : the variance about its own mean and the square of 
the bias. If optimum allocation is used (with, of course, the A’h replaced 
by their estimates) the first component is The total vari¬ 

ance is 


( 11 ) 


n 




A more general form of this expression was given by Stephan (1941). 
He points out that the first term in (11) will usually be about the same 
size as (10)—they are exactly the same if the variance is the same in 
all strata. The loss of accuracy from incorrect weights thus depends 
mainly on the size of the bias, which in individual cases might either 
be small or large. Further, for any given set of erroneous weights, the 
loss varies with the size of sample taken. This is so because the bias 
component of the total variance is independent of the size of sample. 
With increasing sample size, a stage is reached where the bias term pre¬ 
dominates, and where the stratification would be less accurate than 
simple random sampling. 

The preceding discussion does not help much in considering whether 
to stratify in a survey where the weights*are known to be in error, 
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the size of the bias term cannot be predicted. Sometimes a stand- 
error can be attached to the estimate of each Ni^, from knowledge 
of the process by which these were estimated. If the estimates of the 
are independent, and independent of the yug, the average value of 
tho bias component of the total variance is roughly (Cochran, 1939) 

(12) S(yhp - yp)2 V{Nr,)/N^ 

where V(Nh) is the variance of our estimate of Ni^. This quantity mea¬ 
sures the expected increase in variance due to errors in the 

King, McCarty and M c P e e k (1942) applied this formula 
in research directed towards the estimation of yield per acre, protein 
and test weight of wheat in the wheat belt. They discuss the advisa¬ 
bility of stratification by districts within each state. The total acreages 
Nit for each district were themselves estimated by a sample survey, 
so that some knowledge of the F(^h) was available. 

In sampling human populations, the use of erroneous strata totals 
can often be avoided by area sampling, as discussed in sections 7.2 
and 7.3. 

S,5. The problem of non-response. In many types of survey, there are 
certain units in the sample from which the desired information cannot 
be obtained at the first attempt. With human populations, this group 
may be persons who are not at home, or who do not reply to a mail ques¬ 
tionnaire. Similarly, in crop surveys certain fieldl^in the sample may 
not be ripe when the sampler reaches them. This 'non-response** 
group constitutes an important practical problem. To obtain infor¬ 
mation from it may require several attempts and be costly. To ignore it 
may result in a sample that has a bias of unknown dimensions. An 
ingenious application to this problem of the idea of stratified sampling 
has been made by Hansen and Hurwitz (1946). 

The population is envisaged as containing two strata. One, of size 
Ni, contains units that provide the information at the first try. The 
second, of size iNTg, is the non-response stratum. The basic idea is that 
the second stratum should be sampled at a lower rate than the first, 
since the cost per unit is higher in that stratum. There is, however, 
the complication that neither the values of Ni and Ag, nor even the units 
that fall in the two strata, is known in advance. 

The first step, in the simplest case, is to take a random sample of n 
units. Of these let n^ be the number that provide the data sought, 
and n-g the number in the non-response group. By repeated efforts, 
the data are later obtained from a random sample of r^ out of the Wg. 
If n-g = hr^t the quantity k is the ratio gf the sampling rate in the first 



W. O. COCHBAK 


53 


stratum to that in the second. The values of n (initial size of sample) 
and k are chosen so as to give a specified accuracy for the lowest cost. 
The cost of taking this sample is 

(13) ' c„n f f 

where the c’s are costs per unit: is the cost of making the first attempt, 
while Cl and Cg are the costs of getting and processing the data in the 
two strata respectively. Since the values of and will not be known 
until the first attempt is made, the expected cost must be used in.plan¬ 
ning the sample. The expected values of and are respectively 
and W^njk, where as previously Thus expected cost 

is 

(14) f c^W{vi f c^W^n k. 

The estimated population total is taken as 

{ »iyi. i } 

and its variance is shown to be 

(15) N(N-n) <^- 1)^1 jL 2 ^ s 

n n 

where cr^ is the variance in the whole population and is that within 
the non-response stratum. The first component is the variance that 
would be obtained if all in the non-response group were sampled; 
the second is the increase from sampling only of the n^. The quan¬ 
tities n and k are then chosen to minimize (14) for a pre-assigned value 
of (15). 

The solutions depend on the unknowns and If fairly close 
estimates of these can be made from earlier experience, the estimates 
may be used in place of the unknowns. Even if nothing is known in 
advance about and the authors develop an alternative method 
that gives in most cases a solution close to the optimum. Extensions 
to stratified sampling and to ratio estimation are also presented. 

(). Optimum Size of Sampling Unit: Cluster Samplin*; 

In certain types of survey the size of unit may be varied over quite 
a wide range. In accordance with the general principle, the best size 
must depend on a balance between the accuracy obtained from a given 
size, and the cost of sampling with that size. An investigation by .lessen 
(1942) presents a good illustration. • 
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The population consisted of the farms in Iowa. The unit was a com¬ 
pact area of land delineated on the map, or more accurately all farms 
defined as belonging to this area. While certain sizes of area (e.gr., mul¬ 
tiples or submultiples of a square mile) have particular practical conve¬ 
niences in Iowa, the size will be regarded as capable of continuous va¬ 
riation. For simplicity in presentation, all areas of a given size are 
assumed to contain the same number of farms, and the variance of any 
item between farms within areas of the same size is assumed constant 
over the state. Neither assumption seriously vitiates the conclusions 
in this case. 

d.I. The variance function. For some common farm economic items, 
Jessen found that the variance W between farms within an area which 
contains M farms is given by the equation 

(16) W - AM^, g > 0, 

where W is measured on a single-farm basis, and A and g are constants 
independent of M. In this model W increases as the size of area in¬ 
creases, the curve being concave upwards. This increase is familiar 
in farm sampling, and may bo attributed to the fact that many forces, 
including weather and soil type, tend to exert a similar influence on 
farms that are close together. 

Suppose that a random sample of n of these areas is selected. The 
variance that wo are interested in is that of the estimated population 
total or mean: Jessen considers the latter. If B is the variance be¬ 
tween areas (on a single-farm basis) the variance of the sam 2 )le mean 
per farm is BIMn, since the sample contains Mn farms (finite popu¬ 
lation correction is neglected). Thus we require knowledge of as a 
function of M. 


The relation between B and W is supplied by the following analysis 
of variance for all farms in the state. The number of farms in the state 

is N, so that the number of areas is NjM. 


d.f. 

Mean square 

Between areas with M farms / — l) 

\ M 1 

B 

N 

Within areas between farms ^ — 1) 

W 

Total between farms in the state (N—1) 

T 


From the additive property of sums of squares, it follows that 

i\n\ . M)B _ f ^ .rn N(M \)W 
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It will be noted that T does not depend on M. Substituting for W 
from (16) and dividing by Mn, wo express the variance of the estimated 
population mean per farm as shown below. 

(18) V(M, n) = { MiN -^T-NiM-^AM* )IMn(N-M) 
Assuming N large, Jessen simplifies this to 

(19) V'{M, n) =- ^ (M ■ \ 

To digress for a moment, the whole population might be regarded 
as a single sampling unit of size N. Consequently, if formula (16) still 
holds for such large units, we ma^ substitute T — AN* in (18). This 
reduces the number of unknown constants to be determined. Hen¬ 
dricks (1944) found this relation to hold satisfactorily for corn and 
wheat acreage data, and M c V a y (1947) has applied it to the estima¬ 
tion of the proportion of orchards that grow peaches. It may happen, 
however, that the formula for W, while remaining valid for the range 
of values of M that we are likely to consider, does not hold out to the 
value N. In this case the more general relation (18) should be used. 
The constants T, A , and g must of course be estimated from data. 

6.2. The cost function. Jessen distinguishes two elements of cost. 
The element c^Mn comprises costs that vary directly with the total 
number of farms : thus contains the cost of an interview and the cost 
of travel from farm to farm within an area. 

The second element, c^y/n, measures the cost of travel between the 
areas. By tests on a map it was found that this cost, for a fixed popu¬ 
lation, varied roughly with the square root of the number of areas. Total 
cost is therefore of the form 


( 20 ) 


C(M. n) - CjiV/H + Cg^ n. 


Equation (19) for the variance is then minimized with respect to varia¬ 
tion in 31 and n, subject to the restriction (20). While there is no neat 
explicit solution, the numerical solution in a specific case is not difficult. 

One form of the theoretical solution for , obtained after some mani¬ 
pulation,- leads to some general conclusions that are of interest. 


( 21 ) 


M dV' _ f I , 4Cc^M] ^ 

FdM ■ I ' c.,* J 


The left hand side is purely a function of 3t and the constant* T, A, 
and g: it does not depend on n or the east faetor*. Consequently, 
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so far as cost factors are concerned^ the optimum M depends only on the 
quantity q = Ccjc^^, Further, it may be shown that as q increases, the 
optimum M decreases. But Cj increases as the length of interview 
increases, while Cg decreases if travel becomes cheaper, or if farms become 
more dense. These facts provide the general conclusion that, other 
things being equal, the optimum size of samoling unit becomes smaller 
if (i) the length of interview increases, (ii) travel becomes cheaper, 
(iii) the elements (farms) become more dense, or (iv) total amount of 
money available (C) increases. 

With urban sampling, the sampling units that suggest themselves are 
the individual, the household, and the group of households. Hansen 
and Hurwitz (1942) used the name cluster for a group of elements (e.gr. 
individuals) that constitute a sampling unit. They present examples 
which show that for certain items in urban sampling the variance func¬ 
tion is quite different from that used by Jessen. In estimating the sex 
ratio, for instance, the variance B between households is only about half 
as large as the variance T between individuals, whereas in formula (17) 
B is always envisaged as being greater than T, The common presence 
of both husband and wife in the same house introduces a negative corre¬ 
lation between the sexes of members of a household. For this reason, 
the authors have preferred to express their mathematical model in terms 
of the intra-cluster correlation coefficient, which may take either po¬ 
sitive or negative values. 


7. SUBSAMPHNO 

With large sampling units, a useful device is to sample only a part 
of each unit that is selected. Thus if the large unit contains M sub-units^ 
we might obtain information from m of these, chosen at random. When 
sub-units within the same unit give closely similar results, common 
sense suggests that it will not be profitable to spend time measuring 
a large number of them, at the expense of decreasing the number of 
units that can be sampled. For instance., in estimating wheat yield 
and quality by sampling at harvest time. King and McCarty (1941) 
found that it was advisable to cut only a very small quantity of wheat 
from each field that was sampled. 

The sampling theory is simple when each unit contains the same 
number M of sub-units, of which m are chosen, and when the variance 
between sub-units.in the same unit is constant. The variance of 
the sample mean per sub-unit is 

(iV‘—n) ^ (M—m) crj ^ 

iV < n M mn 
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where cr^ is the variance between the true, means of the units and n units 
are sampled out of N, An unbiased estimate of this variance is obtained 
from an analysis of variance of the sample. If B is the mean square 
between units and W that between sub-units within units, both being on 
a sub-unit basis, it may be shown that 


E(B) E(W) - 

Consequently, the unbiased sample estimate is 

^ B \ ^ ^ ^ 

"mw L "V A/ A J 

7J. Subsampling when sampling units vary in size. This problem 
has arisen frequently in recent years especially with human populations, 
where the unit may be a city block, or a county, and the sub-unit a 
household or a farm. At first sight a confusing variety of methods of 
sampling and of estimation present themselves. The appraisal of these 
methods and the development of new methods is an important contri¬ 
bution by Hansen and Hurwitz (1948). 

The methods and their properties (^an be illustrated for the simple 
population represented below. 


Unit no. 

i¥i 

Sub-unit values 

' 

Unit total 

(i) 


' 



1 

(i 

1,1,1,1,1,1 


6 

o 

2 

i 0,0 

1 

! 

0 


8 i 16 

i i 


The population has only two units. The first has six sub-units, all of 
which give the value 1 for the item measured. The second has two 
units, each giving 0. Thus is zero. The population total (the quan¬ 
tity to be estimated) is 6. It is proposed to select one unit, so that n 
N- — 2. Two sub-units will be sampled from the unit chosen. The 
sample therefore comprises two of the 8 sub-units in the population. 

The methods and the results for this ])opulation are summarized in 
Table 1, , 

8 
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Subsampling Methods With Units of Unequal Sizes. 


1 

Method ' 

1 

Vi 

W’i 

Estimate 

Values 

Bias* ' 

cr^ 

1 

! 



N M, 




la 

equal 

m 

n m ^ 

12, 0 

u 

36 




M 




ib 

equal 

m 

— • Y 
m 

8, 0 

B 

20 




N M, 


1 


Ila 

equal 

fM, 

— . —. y 
n Wj 

12, 0 

! 

U * 

36 




M 

1 8, 0 ^ 



Ilb ■ 

equal 

'' fM, 

Y 


B 

20 



1 

M 




Ilia 

M 

m 

— • 7 
• m 


U 

12 

I 


\ tM, 

1 




Illb 

Px 

Px 

T- 

0(i) 

U : 

1 

18 






i 



* U — unbiased, B — biased. 


Method la. Choo e a unit at random and m = 2 sub-units from it. Mul¬ 
tiply the sample total Y by MJm to give an unbiased estimate of 
the unit total, and then by NIn, or 2, to give an unbiased estimate of 
the population total. This estimate is 12 if the first unit is chosen and 
0 if the second unit is chosen. The sampling variance of the estimate 
is 36. 

On reflection, the method of estimation leaves something to be de¬ 
sired. The estimate is JV(estimated unit total)/n. But the variation 
in the unit Mala depends on the variation in the sizes Mi as well as on 
that in the sub-unit values. Even if the latter all had the value 1, 
this method would give a large variance if the Mi differed greatly. A 
technique that avoids this type of inflation of the variance is desired. 

Method lb. Same method of sampling. The estimate is the sample 
mean, multiplied by the ijumber of sub-units in the population: i.c., 
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MYlnij or in this case 47. The two possible estimates are 8 and 0. 
Since their mean, 4, does not equal the true population total, the esti¬ 
mate is biased. The error variance‘(about the true population total) 
is -f 62), or 20. Despite the biai, this estimate is more accurate than 
la. The reason is that since the estimate is based on the sample mean 
its error is not inflated by variations in the 

Method I la. Select a unit at random as before, but take Wj 
(proportional suhsampling). This procedure is derived from the idea 
that large units should in some way receive more representation in the 
sample than small units. The sample will be of size 3 if the first unit 
is chosen, and of size 1 if the second is chosen. While it may seem 
undesirable that the sample size should depend on the particular units 
selected, over a number of strata the actual size would be near the 

expected size. The estimate is analogous to that in la ; i.e., F. 

The reader will find that this method gives exactly the same estimates 
as la and hence has the same variance, 36. 

Method Ilb. Sampling method as in Ila: estimate as in Ib. (ilf F/wj). 
Results are the same as in Ib, the estimate being biased, with variance 
20 . 

The equivalence of Ila with la and lib with Ib always holds when 
there is no variation within units. When sub-units within the same 
unit differ, as will happen in practice, Hansen and Hurwitz (1943, 
p. 357) have shown that Ib will usually be more accurate than lib. 

Method Ilia, The authors projiose to give greater representation 
to large units by drawing the units, not with equal probabilities, as in 
all previous methods, but with probability proportional to their sizes. 
Thus Pi—-MJM. A probability f is assigned to the large unit and ^ 
to the small unit. As in methods I, two sub-units are sampled from the 
unit chosen. The estimate is MYjm, or 4F. In repeated sampling 
we get an estimate 8 in f of the samples, and one of 0 in the remaining 
J . The estimate is unbiased. Its variance is 

^‘(2)2 f J(6)2 - 12 

This value is considerably smaller than that given by any previous 
method. 

By examination of the sampling error formulae for the different tech¬ 
niques, the authors show that method Ilia will give the smallest 
between-unit contribution to the variance for many types of population 
that appear to be met in practice, b'o far as the within-unit contribu¬ 
tion is concerned, this is npt likely to diffSr greatly in methods Ilia and 
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Ib, which is usually the most accurate of the other methods described 
thus far (method Illb will be discussed in section 7.2). The between- 
unit contribution is quite commonly, though not always, much larger 
than the within-unit contribution. This was the reason for neglecting 
the latter in the example. 

7.2. Case where the sizes are not known. It may happen that the sizes 
Ml of the units {e.g., number of households in a block or county) are not 
known when the sample is drawn, though estimates of them may be ob¬ 
tainable from previous data. Insofar as these sizes are needed for samp¬ 
ling or estimation, time and money must be spent in obtaining them. 
It will be seen from Table 1 that with methods la and Ila we require 
the Ml only for those units that come into the sample. With the more 
accurate methods Ib, Ilb, and Ilia, we must count the total M of all 
the units. If counting is expensive, the cheaper cost of methods la 
and lla may go far to counterbalance their relatively large variances. 

An interesting application of an extension of method Ila is presented 
by the sampling staff of the Bureau of the Census in A Chapter in Popu¬ 
lation Sampling (1947). The primary object of the sample was to esti¬ 
mate the total population in certain congested areas, each containing 
a city and the surrounding rural area. In the cities the unit was a 
block and the sub-unit a dwelling-place. The blocks were stratified 
by estimated size (number of dwelling-places) according to data obtained 
four years previously. This stratification would remove a considerable 
part of the variation of the Mi. The sampling ratio njN and the sub¬ 
sampling ratio 7nilMi were determined so as to minimise for a specified 
accuracy, the total cost of counting the iff, in the sampled units, enu¬ 
merating the m, and tabulating the results. Special methods were de¬ 
vised for trailer camps, institutions, etc., for the rural areas, and for 
blocks reported as having no dwelling-places in the previous data. 

There is another method of sampling (Illb) which requires a knowlege 
only of the iff, that are being sub-sampled. It is in a sense a generali¬ 
zation both of methods Ilia and Ila, and is due to Hansen and Hurwitz 
(1943). It is an application of Ilia in the case where we have only esti¬ 
mates Pj of the relative sizes, though mathematically the P, can be any 
set of positive numbers adding to unity over each stratum . We first 
select a sampling rate t, which may vary from stratum to stratum. In 
the example t is chosen as 2/8, since a sample of size 2 is desired and M 
is 8. A sampling unit is then chosen with a probability P, attached 
to the ith unit. The ilf, is counted for the unit chosen and m, is taken 
as tMijPi. The estimate is Yft and therefore does not require a know¬ 
ledge of M. 

In the example, suppose that we estimated the P, as f for the large 
unit and J for the small. Thfe sample sizes work out at 9/4 for the large 
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unit and 3/2 for the small. We shall assume that samples of these 
non-integral sizes could actually be taken (they could be approximated 
closely if the were large). The estimates are 9, with probability 

and 0 with probability The estimate is unbiased (this is always 
true). The sampling variance is {1(3)^ + ^(6)^}, or 18. 

The reader may verify that if P, = MJM, the method reduces to 
Ilia, while if Pj = 1 /N, the method reduces to Ila. When the Pj differ 
from MJM, the sampling error is increased to some extent through 
the variations in the though not greatly if the estimates of size 
are good. 

7.3, Further comments. Methods Ilia and Illb have been extended to 
stratified sampling and to ratio estimation (loc. cit.). When only one unit 
is sampled per stratum, the actual drawing of the unit is simple. The Pj, 
or a convenient multiple of them, are cumulated. If their grand total 
is G, a random number r is chosen between 1 and G. The unit which 
contains this number in the list of cumulative totals is the unit selected. 
Since mathematical complications enter when more than one unit per 
stratum is to be drawn, it is customary to stratify to the point where 
one unit per stratum is taken. 

With methods la or lla it is highly advisable to stratify by estimated 
size if the are likely to vary considerably. With methods Ilia 
and Illb, however, stratification can be by other factors, since size 
effects are removed by selection of units with probability proportional 
to size. It is worth emphasis that with methods la, Ila, or Illb the 
stratum total numbers of sub-units need not be known exactly. Thus 
these methods allow stratification without risking the bias that may 
be introduced by the use of erroneous strata totals, as discussed in 
section r>.4. 

When only one unit is sampled from a stratum, the subsample from 
that unit should represent the stratum rather than the unit. In some 
cases it is possible to stratify the sub-units in the stratum by a criterion 
different from that used in forming the original strata. If so, an in¬ 
crease in accuracy may be secured by drawing the subsample so that 
it is stratified according to this criterion. The sampling error formula 
for this technique, which is known as area substratification, will be 
found in the same reference. 


8. {Systematic Samplinc^ 

If the units in a population are numbered from 1 to — nk, a common 
method of drawing a sample of n is to take a random number between 
1 and k, say r, and draw the rth unit and e^jery A;th unit thereafter. This 
type of sample is called a systematic sample. It can be drawn more 
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quickly than a random sample and intuitively seems likely to be more 
accurate, since it spreads the sample evenly over the population. 
In some respects it resembles a stratified random sample in which 
each stratum has k units, and one unit is sampled per stratum. The 
difference is that in the systematic sample the unit sampled always 
occurs at the same place in the stratum. Frequently it is used mainly 
for convenience, the order in which the units are numbered having no 
particular significance. In this case it may be predicted that the sys¬ 
tematic sample will give about the same accuracy as a random sample 
of the same size. It has, however, not proved easy to make general 
statements about the accuracy of systematic samples. 

The sampling theory was investigated by W. G. and L. H. M a d o w 
(1944). They give several formulas for the variance of the sample mean, 
of which one may be quoted. In our notation, this is 


[N-I 4 2 ^, l\ ' ] 

I i\n J 

where cr^ is the population variance and is the noncircular 

serial correlation coefficient with lag kd, defined by 


k{n ~~d)(rY^^ - X //p)- 

i*! 

The difficulty is that the accuracy depends on the nature of the lag 
correlations, such as are caused by any continuous variation in the 
items yj. 

If the major variation is a linear trend, the Madows show that the 
systematic sample is more accurate than a random sample, but less 
accurate than a stratified random sample with one unit per stratum. 
If the major variation is periodic, the systematic sample is highly accu¬ 
rate if k is an odd multiple of half the period, but is inaccurate if k is 
a multiple of the period. If the major variation is such that p\ is a 
positive, monotone-decreasing, and concave upwards function of 
the systematic sample is always at least as accurate, on the average, as 
the stratified random sample (Cochran, 1946). This type of population 
was studied because in it the variance within a group of i consecutive 
units increases as i increases, as often seems to be the ease in practice 
(c.y., Jessen^s variance formula given earlier has this property). 

Investigations of this type must be supplemented by examination 
of the types of continuous variation that are encountered in practice. 
There is reason to believe that frequently the systematic sample will 
be substantially more accurate than either the random or stratified ran¬ 
dom samples. For instance, Johnson (1943) studied 13 natural 
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populations in which the observations were the numbers of seedlings in 
successive feet in a forest nursery bed. Five species were represented. 
In seven beds containing seedbed stock with high variability, the 
variance of the systematic sample was about half that of the stra¬ 
tified random sample. In the remaining six beds, which had rather 
homogeneous transplant stock, the systematic sample was aboiA equal* 
in accuracy to the stratified random sample and considerably more 
accurate than the random sample. Osborne (1942) found the sys¬ 
tematic sample twice to four times as accurate as the stratified sample 
in estimating the areas under different types of cover (e.g., grass, wood¬ 
land) from a map. In both investigations the stratified sample had 
a stratum of size 2k with two samples per stratum so as to permit 
estimation of the sampling error. It appears, however, that the 
results would bo little changed if the stratum size were reduced to k. 

For a given population, the variance of the systematic sample mean 
is likely to bo a much less stable function of n than with the random 
methods of sampling. This is illustrated by a silver maple bed from 
Johnson’s data (L.H.Madow, 1946). Variances of sample means for 
samples from = 10 to — 84 are shown below : the value of N was 
420. 


TABLE 2 

Variances of Sample Means 
(from L.H.Madow, 1946) 


Typo of sample 


n 

Random i 

j 

♦Stratified 

random* 

♦Systematic 

10 

10 -29 ! 

7-21 

4 *21 

21 

4-77 

3 00 

3 06 

28 

H •.'52 

2 09 

2-42 

HO 

H -26 

, 1 -90 

0-69 

42 

2-26 

1 -20 

1 -74 

60 i 

1 -51 

0 *82 

: 0-26 

84 i 

1 

1 *00 

0 -51 

1 -22 

* One unit per stratum. 




The rather erratic behavior of the systematic sample is evident. For 
some sample sizes (n ~ 10, 30, and 60) there are striking gains over the 
stratified sample; for others (n = 21, 28, and 42) the variance is slightly 
higher than for stratified sampling; while for n — 84 the variance is 
actually higher than with simple random sampling. This type of effect 
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is to be expected. The systematic samples of size 60, for instance, are 
each composed of two of the samples of size 30. Thus there is a posi¬ 
tive correlation between .the variances for = 30 and w = 60. 

It is well known that from the results of a single systematic sample 
one cannot obtain an unbiased estimate of the sampling variance of 
,the mean that will be valid for any type of population. It should be 
feasible to develop estimates that will bo adequate for practical pur¬ 
poses, given some knowledge of the type of population that is being 
sampled. With his data, Osborne (1942) obtained good results from a 
formula S* (l—f2j^2n, where jg the mean square successive difference 

n-l 

" (^1 average of the squared correlations 

i-l 

between a unit in the sample and all other units in the same group of k 
units. Further study of actual populations will be profitable. 
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R48uin4 

Lorsqu’on effectue un Bondage, on vise soit k obtonir le maximum 
de precision dans les estimations pour une d6pense donn^e, soit k mini- 
miser le cofit d’estimaticms d’un degr6 d6termin6 de precision. Les 
recherches aux Etats-XJnis sont regies par ces principes. Un principe 
encore plus g6n6ral a 6t6 introduit par Blythe et Nordin, Suivant ce 
principe, le cofit optimum et la precision optimum sont d6termin6s simui- 
tan6ment en minimisant le cofit de I’enquete et le cofit de decisions er- 
ron6es dfies k Timperfection des estimations. 

Dans la communication sont examines: 1) les estimations du total 
de la population, 2) la m^thode du sondage aleatoire stratifie, dont quel- 
ques nouvelles applications ont 6t6 d6vouvertes, 3) le choix optimum de 
runit6 d’Achantillonnage, 4) la m6thode de sub-6chantillonnage, 5) la 
m^thode du sondage syst^matique, trfes souvent utilis^e en pratique, 



SEQUENTIAL ANALYSIS 


by Abraham Wald 

Ooluinbia University {United States) 

Sequential analysis has been developed in the last four years \vith 
special reference to the problem of testing statistical hypotheses. 

The notion of a statistical hypothesis may be defined as follows: Lot 
Z be a random variable whose probability distribution is known except 
for the values of some parameters involved in the distribution function 
of X. For example, we may know that the distribution of X is normal 
but we do not know the mean value or the standard deviation of the dis¬ 
tribution. Suppose that k unknown parameters involved 

in the distribution of X. A statement about the values of the unknown 
parameters is called a simple hypothesis if it determines uniquely the 
values of all k parameters. It is called a composite hypothesis if it is 
consistent with more than one value of some parameter. For example, 
if there are two unknown parameters di and the hypothesis that 
$1 = 2 and O^i = 3 is a simple one, while the hypothesis that is a 

composite one. 

An essential feature of the sequential method for testing a statistical 
hypothesis H is that the number of observations required by the test 
procedure is not determined in advance but is dependent on the results 
of the observations. The nature of the sequential test procedure may be 
described as follows: A rule is given for making one of the following 
3 decisions at each stage of the experiment (at the mth trial for each 
integral value m): 

1) to accept H; 

2) to reject H; 

3) to continue the experiment by making an additional observation. 
Thus, such a test procedure is carried out sequentially. On the basis 
of the first observation one of the above mentioned 3 decisions is made. 
If the first or the second decision is made, the process is terminated. 
If the third decision is made, a second trial is performed, etc. This pro¬ 
cess is continued until either the first or the second decision is made. 
The number n of observations required by such a test .procedure is a 
random variable, since it depends on the outcome of the observations. 

The problem of sequential analysis arose in this country in the Statis¬ 
tical Research Group of Columbia University about four years ago in 
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connection with a question posed by Captain Schuyler in the 
Navy Department. M. Friedman and W. Allen Wallis, both 
members of the Statistical Research Group at that time, recognized 
the great potentialities of the sequential method of sampling and 
suspected that a sequential test procedure may exist which requires, 
on the average, a substantially smaller number of observations than 
equally reliable tests based on a predetermined number of observations. 
They proposed the problem of sequential analysis to me and the results 
of my investigations then led to the development of the so-called se¬ 
quential probability ratio test [1], [2].* 

Independently of the developments in this country, G. A.Barnard 
in England recognized the merits of sequential sampling. A summary 
of some of the work he and his associates had clone during the war along 
these lines was recently published [9]. 

It has been shown (section A.7 in [2]) that the sequential probability 
ratio test eifects the greatest possible saving in the average number 
of observations, when used for testing a simple hypothesis against a 
single alternative. It frequently results in a saving of about 50 percent 
in the number of observations over the most efficient test procedure 
based on a fixed number of observations. 

The sequential probability ratio test for testing a simple hypothesis 
Hq against a single alternative hypothesis]Jjyi is defined as follows: Let 
0) be the probability density function of the chance variable X under 
consideration. Let, furthermore. be the hypothesis that 0 — Oq and 
the hypothesis that 0^0^ where Oq and Ox are given values. The 
I)robability density of the sample of m observations .Tj, is then 

given by 


and by 


^ Im /(;ci, Oi) di) when is true 


-^om ••■/(!«;». ^o) when is true. . 


At each stage of the experiment, at the with observation for each 


integral value m, we compute the probability ratio 



p 

(1) ^ certain preassigned value B 

^om 


♦ Numbers in brackets refer to literature references listed at the end of this 
paper.. 
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W6 terminate the process with the acceptance of If 
P 

(2) S ^ certain preassigned value A 

p Om 

we terminate the process with the rejection of //q. If 

(3) B < < A 

^ Om 

we continue the experiment by taking an additional observation. 

For-purposes of practical computations it is convenient to take loga¬ 
rithms on both sides of the above inequalities. The reason for this is 

p 

that log can be written as the sum of m terms 

P «ni 


log 



1«M 4 


4 l(){i 


th) 


p 

which is easier to compute than the original ratio 

^Oni 

In carrying out such a test procedure, we may commit two kinds of 
errors. We may reject Hq when Hi is true (error of the first kind), and 
we may accept IIq when IIi is true (error of the second kind). Let a 
denote the probability of committing an error of the first kind, and fi 
the probability of committing an error of the second kind. It has been 
shown that the following inequalities hold : 


(4) 



and 




A 

1-a 


If the alternative hypothesis IIi is fairly near the null hypothesis, that 
is, di is fairly near practical purposes we may replace the in¬ 

equality sign in (4) by the equality sign. Thus, if 0i is fairly near Oq and 
if we want a test procedure such that the probability of an error of the 
first kind is equal to a and the probability of an error of the second kind 
is equal to P, for all practical purposes we may ])ut 


^4 L_j^ and B = / 

CL 1 — a 


Apart from a slight approximation (caused by neglecting the excess 


of the probability ratio 


over the boundaries A and B at the termi- 

Pom 


nation of the process), the sequential probability ratio test is an optiminn 

A 



70 


INTBRNATIONAL STATISTICAL CONFERENCES: I S I 


procedure in the sense that the average number of observations needed 
for the test is a minimum as compared with any other (sequential or 
nbn-sequential) test which controls the two kinds of errors to the same 
extent. 

Although the sequential probability ratio test is defined for testing a 
simple hypothesis against a single alternative it can be used for testing 
simple and composite hypotheses concerning 0 also when 0 can take in¬ 
finitely many values, as it is usually the case in applications. A general 
theory for the construction of the sequential probability ratio test in the 
case when the parameter d can take infinitely many values, together 
with a brief discussion of a number of important special cases, is given 
in [1] and [2]. A more detailed discussion of a number of applications 
of the sequential probability ratiotest, together with a considerable 
number of tables, charts, and computational simplifications, is obtained 
in a report of the Statistical Research Group of Columbia University [3]. 
Among the special applications discussed in [1], [2], and [3] are, for ex¬ 
ample, tests relating to the mean of a binomial distribution, tests relating 
to the mean of a normal distribution when the standard deviation is 
known or unknown, and tests relating to the standard deviation of a 
normal distribution when the mean is known or unknown. Further 
applications relating to the comparison of two populations, as well as 
interesting theoretical contributions, are contained in a paper by M. A. 
Girshick [4]. 

As an illustration, I should like to discuss briefly an example. Let 
the chance variable X under consideration‘be normally distributed with 
unknown mean 6 and known variance. Suppose that we wish to test 
the hypothesis H that 0 ^ 0\ It will, in general, be possible to deter¬ 
mine two values Oq < 6* and > 0' such that the rejection of H is con¬ 
sidered an error of practical importance whenever 0 ^ 0q, the acceptance 
of H is regarded an error of practical importance whenever 0 ^ 6^, while 
for 0 between and 0^ we do not care particularly which decision is made. 
Under such circumstances we shall want a test procedure for which 
the probability of rejecting H does not exceed a certain preassigned 
value a whenever 0 ^ 0^, and the probability of accepting H does not 
exceed a certain preassigned value fi whenever 0 ^ 0^. These conditions 
will be satisfied by the sequential probability ratio test for testing 0q 
against the constants A and B being determined so that the proba¬ 
bilities of the errors of the first and second kinds are equal to 
a and >9, respectively. The sequential probability ratio test leads 
to a procedure which can be represented graphically as follows : 
Two parallel lines and are drawn whose intercepts and common 
slope depend only on a, fi, 0^^ and 0^. Thus, these two lines can be cons¬ 
tructed before experimentation starts. At each stage of the expert* 
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ment, at the with observation for each wi, the cumulative sum S of 

i-1 

the first m observations is computed and the point (m, I,x^) with ab- 

m 

scissa m and ordinate S is plotted. We continue taking additional 

i-1 

observations as long as (m, lies between the two lines. At the first 
time when {m, Sa:^) does not lie between the two lines the process is termi¬ 
nated. The hypothesis H is accepted if (m, SaJi) lies on Lq or below, and 
H is rejected if (m, Sarj) lies on or above. 

Practical applications of sequential analysis have been made so far 
mostly in connection with acceptance inspection and quality control 
of manufactured products. The application of sequential analysis is, 
however, by no means restricted to this field. It can be used with ad¬ 
vantage in all empirical fields of investigation where the data are not 
given historically but have to be obtained from experiments which can 
conveniently be arranged in a time succession so that at each stage of 
the experiment the experimenter can freely decide whether experimen¬ 
tation be terminated or an additional trial be performed. In some ex- 
perimentotion the performance of a trial may require a relatively long 
period of time. In such cases it may not be practicable to wait with 
the performance of the next trial until the result of the preceding trial 
is known. Instead, a large number of trials have to be performed simul¬ 
taneously. Under such conditions sequential analysis is, of course, not 
practicable. 

Sequential analysis has been developed so far mainly for the purpose 
of testing a statistical hypothesis. A more general problem is this: 
suppose that k mutually exclusive and exhaustive hypotheses Hi, 
are formulated and the problem is to accept one of them on the basis 
of the sample. This multi-decision problem contains the problem of 
testing a hypothesis as a special case when k ~ 2, A possible approach 
to the problem of sequential multi-decisions is briefly outlined in [2]. 
This field, however, is not yet sufficiently explored and further progress 
is still a matter of future development. 

Another important problem, about which we do not yet know much, 
is that of sequential estimation. The problem of sequential interval 
estimation may be formulated as follows: A class C of intervals is 
given. For example, the class C may be the class of all intervals of a 
given length. Furthermore, a number a between 0 and 1 is given. The 
problem is then to construct a rule which tells the experimenter when 
to stop experimentation and what element of C be selected at the termi¬ 
nal stage. The rule must be constructed so that the probability that 
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the selected interval will cover the true parameter value is at least a. 
A general sequential estimation procedure satisfying this condition is 
briefly described in [2]. It is, however, rather doubtful whether the 
procedure given there is anywhere near an optimum procedure. The 
problem of finding a general method for obtaining efficient sequential 
estimation procedures is still far from solved. For the case of estimating 
the mean of a normal distribution with unknown variance, G. Stein 
[5] has devised a very interesting sequential two-sample procedure 
which leads to confidence intervals of fixed length independent of the 
value of the population variance. 

Finally, I should like to mention some important recent results con¬ 
cerning sequential point estimation. The problem of obtaining unbiased 
estimates of an unknown parameter on the basis of a sequential 
sample is by no means a simple one. This problem was solved for the 
binomial case by Girshick, Hosteller and S a v a g e [6]. More 
general results were obtained by Blackwell [7]. Important results 
giving a lower bound for the variance of any sequential estimate were 
obtained byWolfowitz [8]. 
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Hisumi 

La methode de Score (“sequential analysis’’) a ete d^veloppee, dans 
les quatre derni^res ann^>es, sp4cialement en vue du probl^me de tester 
la vraisemblance d’une hypothise statistique. Une caracteristique 
essentielle de cette m6thode consiste en ce que le nombre des observa¬ 
tions demand6es pour le test n’est pas fixe k I’avance, mais qu’il de¬ 
pend des r^sultats des observations. La procedure est la suivante: 
Une rfegle est donnee permettant a chaque stade des operations (a la 
m-ifeme observation pour chaque valeur integrale de m) de savoir si Ton 
doit: 1) accepter I’hypothfese H soumise au test; 2) rejeter H; 8) conti¬ 
nuer I’operation par une observation supplementaire. 

II a 6t6 montre que le soi-disant “sequential probability ratio test” 
permet la plus forte reduction possible du nombre moyen d’observa¬ 
tions, lorsqu’on I’utilise pour tester une hypothfese simple centre une 
seule alternative. On obtient sou vent une reduction d’environ 50% du 
nombre des observations sur la procedure la plus efficiente basee sur 
un nombre fixe d’observations. Des applications du “sequential pro¬ 
bability ratio test” ont ete faites A plusieurs problemes sp6ciaux, tels 
que des tests concernant la moyenne d’une loi binomiale ou de Pois¬ 
son, concernant la moyenne d’une loi normale quand recart-t 3 rpe est 
connu ou inconnu, des tests concernant I’ecart-type d’une loi normale 
quand la moyenne est connue ou inconnue, etc. 

Comme il est dit plus haut, la Methode de Score a ete d6velopp6e 
principalement en vue de tests d’hypothfeses statist!ques. Un autre 
probleme important, au sujet duquel on ne sait encore que peu de chose, 
est celui de I’estimation par la Methode de Score. D’importants r6sul- 
tats ont et4 obtenus recemment par divers auteurs am6ricains concer¬ 
nant des estimations, sans erreur systematique, appel^es “unbiassed 
seqiiential point estimates” et leurs variances. 


10 
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Discussion 


Prof^or Tornqviat : In recent years the theory of Sampling, Esti¬ 
mation, and Sequential Analysis has made good progress. We all know 
the remarkable works of Fisher, Neyman, Frisch, Cram6r,Wold, Eeiers^l, 
and Hauvelmo. We have today heard of many new interesting results 
obtained by distinguished American and English authors. Also among 
German authors, I think of H. Gebelein’s interesting attempt in his book 
''Zahl und Wirklichkeit*' and of S. Koller’s book “Graphische Tafeln 
zur Beurteilung statistischer Zahlen,” which have made valuable contri¬ 
butions to the subject. Two Finnish authors, K. Karhunen and G. 
Elfving, have recently published works on the theory of sequential 
analysis. The former’s dissertation treatise for the degree of doctor, 
“Uber lineare Methoden in der Wahrscheinlichkeitsrechnung,” contains 
a strictly mathematical foundation foj* the theory of linear expressions 
of stochastic functions. Elfving has published works on stochastic 
sequences especially on Markoff processes. 

The theory of sampling deals with the problem of determining the 
distribution functions for functions of sampled values, when the distri¬ 
bution function of the* parent population is known. The theory of esti¬ 
mation deals with the inverse problem of estimating functions (or para¬ 
meters) of the parent population or of new samples, by means of a se¬ 
quence of sampled values. For the case of a finite parent population 
Hans Gebelein gives in his book some interesting results of which I will 
speak here. He solves the problem of inversion in a new way. 

When we take a random sample containing [n] individuals in all from 
a parent population with [N] individuals distributed among k alternative 
classes as the number system N = ..., N^) describes, the probabi¬ 

lity of getting a sample with n^ individuals belonging to the class 
n:o 1, nj individurils to the class n:o 2, and so on, is, as is well known. 



In the case, when the total number of individuals in the parent popu¬ 
lation [N] and a sample n' are the only facts which are known, Gebelein 
defines the inverse probability of the possibility that in the parent popu¬ 
lation there were N = ..., individuals in the different classes, 

by means of the formula 


(2) 


p(N-, [Nln’) = (J)/( 

/ 


[N]+k-l 


/’''[«']+ifc-i / 
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The most interesting formula is, however, the formula for the 
tial probability” 


(3) ' Pin; [n], n\ [N]) 




[n] + [»'] + k — 
[»'] + fc — 


;)• 


“sequen- 


This sequential probability will numerically fix our anticipations of 
getting a new sample, in which the individuals are distributed among 
the k different classes as the number system n -= (nj, n^) describes, 
from the same parent population from which we already have taken a 
sample with individuals distributed as the number system n* =( 11 /,..., 
<). 

The probability distribution (3) for the sequential probabilities is 
consistent with (1) and (2) because we have in fact 


Pin; W, n, [N] ) 2 piN; [N], n') pin; W, N--n'), 

Nm 


The sequential probability concept is thus independent of [-^J. 

The weakest point in Gebelein’s theory is, however, the concept of 
the number of classes k of the parent population. He seems to have 
made an implicit assumption that in every class taken into consideration 
there is at least one individual present in the parent population. In the 
cases when the classes are got by subdivisions of larger intervals this 
need not always be true. The number k can then be arbitrarily chosen 
by the investigator. It is, however, interesting to study the suggested 
probability distribution function for the sequential probabilities. 

Gebeleih meets very great mathematical difficulties when trying to 
calculate moments of linear functions depending on the probability dis¬ 
tribution studied.^ By means of probability functionals this may, 
however, be done rather easily. 

The probability functionals corresponding to the three probability 
distributions (1), (2), and (3) can be expressed by the formulas (4), (5), 
and (6). 

The random sampling probability functional is: 

jg _j 

(4) + ^ (1+ty 

y 

The probability functional for Gebelein’s inverse probability distribution 
is 


(5) 


7r(t, 




t ) 




( 


X- 

[«']+* 


^ ) \x;[N]) 

c—1 ' 


' Gebeleit) studies in full only the caaie k = 2 and moments of at most second 
degree. 
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The sequential probability functional is 


( 8 ) 


t T(l-t 

X *** X 


fli 


/X+[n']+k—l 
^ M+Ar-l 



n' 

In these formulas the operator symbol t has the property 

n 

W 

t u (n) u(n + n') 
n 


The operator acts in a similar manner on the variable y and so on. The 
''selecting conditional probability function”: 


(t>(x\ A) = 



if a? c ^, 
„ a: c A, 


The mathematical expectation of functions u(n) of the number system 
w, can formally and often also after some calculations explicitly be cal¬ 
culated by a symbolic multiplication with the corresponding probabi¬ 
lity functional. The probability thatw(n) belongs to a class [ w(w)c.d] 
can in this way be calculated as the mathematical expectation of the 
selecting probability function A) which takes the value 1 \iu(n) 

belongs to the class A, and the value 0 if u(n) does not belong to this 
class. The moments,of the stochastic variable u(n) in respect to the 
sequential probability functional G(tn; can be calculated by a 

serial development of the symbolical product 


(?(T ; W. »') = S G(t :[nj, n') {u(n)r 

n o-o n 

according to increasing powers of A. In the case when u(n) == [uri] = 
we can by suitable transformations of the symbolic product so 
obtained rather easily calculate explicitly the three first moments about 
the mean 

_ . \ 

<3'( ; [»]. »') M =? = »i' 4- 1 

[^] 

The variance will be 


»*();«»]; [»], »') = [»] 
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[jv] + [»] 
[ 1 ?] +1 


br(M — [^M]/[Ar])a] 


15 ?] 
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aad ih© third moment about the mean; 

[»], »') =[»] [jv(a - [ya]/[y])»] 

[N] + 1 [N^ 4“ 2 j-jyj 

The corresponding moments for the direct probability distribution 
P(n; [n], N] are obtained from this formula if we put n ~ N. The 
moments (higher than the first) of the inverse probability distribution 
(2) about the mean 

0( t ; »') iun\ = [«'«] + \N - 

I A'] 


are the same for the sequential probabilities p(N--n; [N—n]y n). 

The distribution functions studied above are all special cases of a 
great class of distribution functions defined by help of this formula 


P, (XdAB- xczB) = I 


TTa-kh t + t 

'“A x„, Xu x„ f 


i-/ 


'TTV' - T (I + T + T + 

x„, 


Xu X 21 


-1 
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Functionals of the above (and suitably generalized) forms can success¬ 
fully be used in attempts to solve other intricate problems of mathe¬ 
matical statistics especially in the theory of transforming time series 
to new time series which can be described as sampled values from a pa¬ 
rent population with a distribution function of some simple form. I 
will not, however, trouble you longer with these intricate problems. I 
wish to thank Professor Yates, Professor Cochran, and Professor Wald 
for their very interesting papers. 

Mr. W. R. Thompson: 

Mr. Thompson called the attention of the meeting to two early articles 
on the notions of sequential analysis and associated apportionment.^ 


Dr. Yates: 

Professor Cochran has raised one or two points on which I should like 
to comment. These were not dealt with in my paper because, as I 

* William R. Thompson, “On the Likelihood that One Unknown Probability 
Kxceeds Another in view of the Evidence of Two Samples,” Biometrikay Volume 2o 
(1933), p. 285; and “On the Theory of Apportionment,” American Journal of 
Mcahe^mticst VoL 57 ((1935). * 
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explained, I was asked to give an historical paper, excluding reoeht 
developments in the United States, which were to be dealt with by 
Profesiior Cochran, 

I did include son^e reference to work done during and after the war 
in England but I omitted the details because the principal modern deve¬ 
lopments have, I think, occurred in this country. The fact that so much 
has been done in recent years in the United States is an excellent illus¬ 
tration of my thesis that theory always develops in conjunction with 
practice. In this country you have employed sampling technique to 
a considerably greater extent than we have, partly, I think, because you 
are less conservative and partly because you have a larger and more dis¬ 
persed population. For that reason recent developments in theory have 
been particularly prolific on this side of the Atlantic. 

Professor Cochran mentioned the non-response problem. We have 
a sub-sample of the non-responding households for further visits in order 
to cut down the number of these visits, though we haven’t developed 
the theory. 

Professor Cochran also mentioned systematic sampling. I might 
amplify the remarks I made on my own work as they tie in directly with 
his. Firstly, the question of what I called in my paper “end-correc¬ 
tions.” Professor Cochran pointed out that if you have a trend and 
take a systematic sample this is likely to be more inaccurate than, the 
corresponding stratified random sample. End-corrections are designed 
to overcome this and consist of altering the weights of the sampling 
units at the beginning and end of the sequence. Thus, if the first samp¬ 
ling unit is right at the beginning of the sequence it will be given half 
weight, if it is distant one sampling interval from the beginning of the 
sequence it will be given a weight of IJ. This type of correction is of 
value not only in the,case of a simple linear trend but in cases where the 
beginning and end of the sequence are widely, different in value. 

Secondly, on the question of estimation of the sampling error of sys¬ 
tematic samples, I would repeat the conclusion that I have reached, 
namely that there appears to be no certain way of estimating the system¬ 
atic sampling error unless additional observations are taken inter “ 
mediate between the main sampling points. In dealing with a standard 
type of material it may well be possible, after a thorough investigation, 
to invent an empirical formula which will give an appropriate estimate 
of the sampling error from the variation between the different sampling 
units^ but I think one must be very careful not to generalize as each type 
of material has its own peculiarities. The difficulties will be apparent 
if one considers the example that Professor Cochran took in his paper of 
19i6. In that paper he showed that with an. autoregressive sequence 
i.e., with an exponential cbrrelogrami the sampling error could be esti^ 
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nlated from the variation between the aggregate of the sampling units 
and the correlation between neighboring units. If, however, we have 
autoregressive sequence on which a random variation is superimposed, 
each unit varying independently, the formula Professor Cochran deve¬ 
loped will give a very misleading answer. 

Finally, on the problem of sequential sampling I would like to make 
one. point. Sequential sampling can be looked at in two ways; firstly, 
from the point of view of testing hypotheses, which Professor Wald ex¬ 
plained; secondly, like all sampling, from the point of view of estimation 
of the parameters of the population. In sequential sampling we get the 
maximum efficiency of estimation when the population parameter has 
a value corresponding to the hypothesis, with a corresponding loss 
of efficiency when the population parameter differs from this value. 
In industrial testing and similar work where one is concerned with con¬ 
formity to a certain standard this property is exceedingly useful and 
results in large gains in efficiency in the sampling process. In sociolo¬ 
gical and economic sampling, on the other hand, one is generally con¬ 
cerned with the estimation of population parameters, and about the 
same accuracy of estimation is required regardless of what value 
the population parameter actually has. For that reason sequential 
sampling is not applicable to problems' of economic and sociological 
sampling to anything like the same degree as it is to problem of indus¬ 
trial sampling. T make this Comment not in any way to deprecate se¬ 
quential sampling, which I Have a very high regard for, but merely in 
order that it should not be applied where it is not really suitable. 

Professor Cochran: ‘ 

I would like to express my agreement with Professor Yates’ views on 
the question of estimating the error of a systematic sample from the re¬ 
sults of a single sample; and to mention that the results which Osborne 
obtained and which showed nice agreement between his formula and the 
data, were based on the assumption of an exponential correlogram. He 
had found that an exponential correlogram fitted the data that he pre¬ 
sented extremely well. So these results do assume, as in some degree 
one must assume, a particular type of auto-correlation structure in the 
population. 

Professor Wald: 

I would like to make just a brief comment on the questions raised by 
Professor Yates. I believe (I don’t know whether I understood him 
correctly) that his comment refers to the actual sampling procedure as 
in use now, and the theory of which has been developed, namely the 
sequential probability-ratio test procedure.’ I would* like to mention 
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that it is conceivable that other sequential test procedures, or sampling 
procedures, can be devised which will give more equal efficiency over 
the whole scale, ^.nd will work from that point of view more satisfacto¬ 
rily than the sequential probability-ratio type of sampling. I wonder 
(could Professor Yates correct me?) whether his remark referred to the 
procedures in actual use, or whether he meant that in general no samp¬ 
ling method can be devised which would give good efficiency over the 
whole parameter space. 

Professor Yates: 

I am not an expert on sequential sampling, but my own view, for what 
it is worth, is that if you work out a sampling procedure on the sequen¬ 
tial basis which is equally efficient over the whole range you will probab¬ 
ly find that it is necessary to take the same number of sampling units, 
whatever the results obtained in the first k sampling units. In other 
words, the ordinary procedure of taking a fixed number of sampling units 
will result. 

Professor Wald: 

I think this has been proved for the normal case; Mr. Stein and myself 
investigated the case of estimating the mean of a normal distribution. 
We found that if we want equal efficiency over the whole scale we have 
to take a fixed-size sample; we cannot do any better. That paper will 
come out, probably, in the Annals of Mathematical Statistics.^ How¬ 
ever, in other types of nonrnormal distribution, we believe that there 
is a considerable gain in the sequential method of sampling, even if we 
merely want estimates which have about equal efficiency everywhere. 


> Volume 18 (1947). 
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1. Inthodlction 

Modern sampling practice is the result of combining statistical theory 
with scientific knowledge about the material that is being sampled and 
with experience that has been gained through the use of various sampl¬ 
ing techniques in surveys and experimental work. Its history stems 
from many roots and its applications branch out into many fields of 
science, cdmmerce, manufacturing, agriculture, education, and govern¬ 
ment administration. In spite of its wide range of usefulness, sampling 
practice has been neglected in the training of statisticians, in the text¬ 
books and treatises, and in the planning and analysis of most experi¬ 
ments and studies [1].^ However, like Cinderella, it has risen from 
neglect to a position of well-deserved importance. 

* Joint meeting with The Econometric Society (arranged by the American Statis¬ 
tical Association). 

♦♦ This paper was prepared in. connection with studies of sampling under the 
Committee on the Measurement of Opinion, Attitudes and Consumer Wants of the 
National Research Council and Social Science Research Council. 

^ Figures in square brackets refer to notes and references listed at the end of 
this paper. 
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. The history of sampling practice provides a useful background for 
the discussion of present theory and applications. Difficulties beset any 
one who attempts to trace the developing uses of sampling because they 
are scattered throughout many branches of science and technology and 
are described, if at all, in. subordinate portions of reports and articles 
whose titles provide no hint of what they may contain on the subject 
of sampling. Hence, this paper not only will +ouch each development 
very briefly and inadequately but no doubt it will miss entirely a number 
of highly important facts. (The author will appreciate suggestions 
for correction and addition). The principal emphasis will be on the 
steps by which the present stage of progress in applied sampling was 
reached and no attempt will be made so present a comprehensive pic¬ 
ture of present-day uses or to appraise the relative value of each contri¬ 
bution to the accumulation of technical knowledge. 

There are two dangers that both author and reader must avoid in an 
historical review: (a) they may read into the records more than was 
actually there, and (b) they may assume that nothing existed that is 
not given in thq records. I hold to the view that the principles and 
technical practices of sampling emerged rather gradually from notions 
that were simpler, sometimes inaccurate and confused, and often not 
recognized by those who held them as being of any special importance. 
Hence the records are fragmentary and there were doubtless many ins¬ 
tances in which principles were developed by two or more workers in 
ignorance of the other’s work*. I would not say that the same discovery 
was made “independently” for there is always a flow of common ideas, 
sometimes rapid and sometimes slow, in which all share. Hence it should 
be understood that the particular examples that will be mentioned are 
part of a larger development of practice and theory which connected 
them in various known and unknown ways and often influenced 
profoundly their characteristics and effectiveness. 

Finally, greater attention will be given to the use of sampling in 
large-scale surveys rather than to its use in the laboratory or in small- 
scale (local) experiments. This accords with the emphasis of the other 
speakers who will follow. 

II. Eably Examples of the Use of Samples 

The earliest examples of sampling procedures are to be found in certain 
very ordinary human activities. The common practice of taking a 
small part or portion for tasting or testing to determine the characteris¬ 
tics of the whole precedes recorded history and is one of the roots from 
which sampling methodology stems. Stirring and mixing before taking 
the sample is a prototype of randomization. The* efforts of scientists 
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And their predecessors to draw conclusions about the laws of nature 
from what they could observe in their immediate environment was a 
sampling process. Astronomy, perhaps the oldest of the sciences, 
started with the moon, the larger planets, and the stars that one could 
see from positions near the equator or north of it. Even today it is 
limited to those heavenly bodies that can be photographed with the 
best available instruments. 

All empirical knowledge is, in a fundamental sense, derived from in¬ 
complete or imperfect observation and is, therefore, a sampling of ex¬ 
perience. An unusually interesting example, not unrelated to modern 
population research, can be found in H a 11 e y’s selection of mortality 
statistics in Breslau to form the basis of his life table. From this sample 
of one city he drew general conclusions pertaining to “the mortality of 
mankind.” [2]. This was in 1693. Two centuries later. Sir John 
L a w e s likewise used the annual record of wheat yields at Rothamsted 
on 5 plots totalling 33 acres to estimate the change in yield per acre 
from 1852 to 1879 for all of England and Wales [3]. While these 
examples were both statistical, all scientific observation, whether statis¬ 
tical or not, is based on sampling. 

In spite of the widespread practice of sampling in commerce and in¬ 
dustry and its utilization in scientific research, official statisticians have 
usually set as their goal the complete counting of a population and have 
sought to avoid any use of sampling or any inference beyond the bare 
description of that population at the time it was counted. Still they 
have been compelled to compromise in the face of practical difficulties, 
6n something less than complete coverage and often also on something 
less than adequate accuracy and quality in the information recorded. 
Such compromises have been common in the collection of many kinds 
of statistics, particularly those usually collected by voluntary reporting 
such as employment, wage rates, prices, and crop yields. It is also found 
in the collection of data that ought to be complete in order to satisfy 
certain non-statistical purposes, as for example of the registration of 
births. Often the official statistician, faced with great difficulties, 
opposition, and indifference on the part of the public and with only 
weak powers to support his efforts, could only compromise or resign, his 
post. The result of the compromise was often a very crude and unsatis¬ 
factory form of sampling which strove to get as much information “as 
possible” and accepted what it got, instead of attempting to control 
the selection by some of the means that were available. 

Interestingly enough, sampling has generally preceded the establish¬ 
ment of regular censuses. Prior to first British Census in 1801 the size 
of the population of England was not known very accurately and 
various speculations were made and estimates prepared and disputed. 
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If 9i 11 h u 8 projected his famous theory of pppulation, and Adam Smith 
Ws WtictUh of Nations, before the establishment of periodic national cen¬ 
suses. At least as early as 1764, estimates of population of England 
were made from the number of houses on the tax list plus a rude estimate 
of cottages not taxed, the total of dwellings being multiplied by a some¬ 
what arbitrary factor of 6 persons per dwelling [4]. Other estimates 
were based on the reported number of baptisms, marriages, and burials. 

In 1800 Sir.Frederick Morton Eden estimated the population of 
Great Britain at 9,000,000 using sample data on the average number 
of inhabitants per house as well as the number of births. The first cen¬ 
sus of Great Britain in 1801 confirmed his estimate. Somewhat similar 
methods of estimation have been used between censuses in the U.S.A. 
fts recently as the last decade [5]. 

About 1765 M e s s a n c e, and 1778 M o h e a u, published very care¬ 
fully prepared estimates for France based on enumeration of population 
in certain districts and on the count of births, deaths, and marriages 
as reported for the whole country. The districts from which the ratio 
of inhabitants to births was determined truly constituted a sample. 
Laplace prepared similar estimates in 1802 from enumeration of 30 
departments of France and the reports of births, deaths, and marriages 
from 1799 to 1802. This followed a plan he published in 1786. He made 
a remarkable step forward in attempting to measure the precision of 
his estimate and announced that the odds were 1161 to 1 that it was 
not in error by more than 500,000 inhabitants or 2 per cent of the total 
population. Even though the method of estimate was crude and 
the measure of precision not wholly valid, Laplace’s effort was much 
more successful than the complete census of France that was attempted 
at the same time. A similar procedure had been employed in 1784-91 
by the famous chemist Lavoisier to estimate the number of horses, 
cattle, sheep, and pigs, as well as the area upder cultivation [6], 

The foregoing examples suggest that modern sampling procedure might 
have developed at least a century sooner than it did if it had received 
more attention from the scientists of the day. Only the officials of 
statistical bureaus and other posts continued to concern themselves with 
the problems of measuring population, and they were preoccupied with 
difficulties in the classification and interpretation of data, in the 
administration of statistical bureaus, and in the important problems 
of trade, finance, industry, agriculture, public health, etc., for which 
statistical data were needed. Hence they falvored complete censuses 
or the closest approach to them that was feasible. 
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ni. Exampi-bs of Dbvxi^fmknt op Nrbd fob Efficient Sampuno 

Methods « 

It would be interesting to explore the development of statistical work 
in Its many ramifications and inquire about the places in which modem 
Mmpling methods could have been used to good advantage. That is 
beyond the possibilities of a paper such as this. Instead examples will 
beginnings of four general lines of statistical work in 
which efficient sampling methods were needed: (a) agriculture crop 
estimates, (b) economic statistics of prices, wages, employment, etc. 
(c) statistical phases of social surveys and health studies, and (d) public 
opinion polling. The more recent developments of the use of sampling 
in these and other fields will be traced in succeeding sections. 

(a) Agricultural Crop and Livestock Estimates: At the present time 
a tremendous variety of statistics are collected in the United States on 
acreage planted in each principal or special crop, the estimated yield 
as judged at successive dates during the growing season, actual yields, 
numbers of livestock, equipment, farm labor, marketing, and other as¬ 
pects of agricultural production. Other countries collect similar statis¬ 
tics with variations in scope, detail, and frequciujy. In the United 
States, as in many countries, the methods used for this purpose include 
periodic censuses, special surveys, voluntary reporting by selected 
respondents, and records produced in connection with taxation, 
marketing, and foreign trade. 

This vast system had its beginnings about a (jentury ago. The first 
U.S. Census of Agriculture was taken in 1840. At the same time collec¬ 
tion of agricultural statistics was begun by the Patent Office. Monthly 
reports were collected and published by the editor of the American Agri¬ 
culturist in 1862 and in 1866 regular reports on acreage, condition of 
crops, yield, and livestock were begun in the newly established Depart¬ 
ment of Agriculture. Annual reports of prices were added in 1867. 
Thereafter the system developed into an extensive organization of 
agents and voluntary reporters that increased from 4,000 in the late 
70’s to 300,000 in 1931 and a somewhat larger number now f7]. (The 
present system is described in a paper presented by Dr. C. F. S a r 1 e at 
this session). The methods of sampling were quite crude, many of the 
reports were simply based on the respondent’s judgment about condi¬ 
tions in his locality and the list of respondents was built up of farmers, 
agricultural agents, members of the staff of agricultural colleges, etc., 
who were willing to serve without pay and were located at places widely 
scattered over the country. The system was a compromise between the 
excessive cost and slow returns of complete enumeration on the cue 
hil-nd and the wholly unsatisfactory alternative of relying on reports 
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issued by private speculators or going without current informationi on 
the other. Various attempts were made to improve the reliability of 
the statistics that resulted from these reports but they continued to be 
biased and of limited accuracy. Nevertheless they have been of great 
value to farmers and to other users of the statistics and they are the 
principal source of current data on agriculture. Here as elsewhere th^ 
introduction of modern sampling methods came late but is now making 
great contributions to the improvement of the statistical information in 
this field. 

(5) Economic Statistics: The history of economic statistics is a 
long and detailed story which can only be sketched here in inadequate 
outline [8]. Again, as for population and agriculture, there were early 
attempts to make the best of scanty and fragmentary material. Cen¬ 
suses and special investigations have provided increasingly valuable 
data but at long intervals and in inadequate detail. 

In many countries, economic statistics derived primarily from, the 
records produced by taxation and customs duties. This was true in the 
United States. Statistics about subjects that were not provided by the 
system of taxation had to be obtained by other means. More than a 
century ago the collection of reports of prices, wage rates, hours of 
work, employment, and production was begun with voluntary repor¬ 
ting by employers and occasional special surveys as the principal 
methods. Massachusetts established a statistical bureau in 1869, Penn¬ 
sylvania in 1870, and other states at later dates; the Federal Govern¬ 
ment set up a Labor Bureau in 1884. These bureaus developed staffs 
of field investigators to collect data at monthly or other periods but 
relied heavily on mail questionnaires for many of their principal series. 
This continues to be the prevalent procedure although the establishment 
of social insurance systems and employment exchanges has provided 
other sources of statistics on earnings and employment. 

Similar systems of collecting reports are operated by other agencies 
concerned with production, trade, and finance. Those inquiries have 
been based on simple sampling procedures such as the use of a scattered 
group of voluntary reporters, except for certain relatively recent sur¬ 
veys. A serious effort was made, for example, to get wholesale prices 
‘"in representative markets’’ and to get labor data by sending agents 
into various districts with a list of employers from which they could 
choose what they believed to be a representative group but the tech¬ 
niques of selecting a representative sample had not been developed as 
formal procedures. Here again modern sampling procedures have been 
introduced late but are making noteworthy contributions, in conjunc¬ 
tion with, other improvements, to the accuracy and value of these 
statistics. ® 
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(c) Social Surveys and Health Surveys: The distinction between 
social surveys and pertain related kinds of inquiries is difficult to make. 
Some, like L e P 1 a y’s monographic studies, are very intensive obser¬ 
vations of a few individuals or families; others include thousands of 
cases but less intensively and with more attention to statistical analysis. 
Williams and Zimmerman listed 1500 studies of family 
living in the United States and elsewhere, made prior to 1935 [9]» 
Boot Vs Survey of London Life and Labour ^ Rowntree’s survey 
of poverty in York, the reports of the Immigration Commission in 
1907, and the Pittsburg Survey of the Russell Sage Foundation are 
examples. While complete and thorough Investigation of the problems 
was the ideal to which such surveys aspired, they were necessarily 
limited to a selected city, and to somewhat fragmentary data on 
pertinent questions by the sheer impossibility of a comprehensive 
canvass. Other surveys were made under the inspiration of their 
example but progress in methodology came slowly and as in many 
other investigations the accuracy of the results was seldom tested. 

Sampling has been used extensively in studies of poverty and unem¬ 
ployment. During the depression of 1873-79 Carroll D. Wright 
used police in 19 cities and wrote to assessors in 375 towns throughout 
Massach^8etts inquiring about the number of unemployed. His esti¬ 
mate of 28,508 corrected the current assertions that 200,000 or 300,000 
workers were out of work [10]. Similarly in 1873 the number of 
unemployed in New York City was estimated on the basis of reports 
from 400 volunteer visitors of the Association for Improving the Con¬ 
dition of the Poor. These procedures were, of course, crude and inaccu¬ 
rate but they reflected a praiseworthy desire to measure what was 
being discussed in still less accurate terms by important public leaders. 
In 1893, unemployment was estimated indirectly by the decline in fac¬ 
tory employment from its highest figure in a series derived from a sample 
of reporting employers constituting 70 percent of the production in the 
state [11]. In 1893, estimates were collected by mail from respon¬ 
dents in 119 cities by Bradstreet. In New York City, Chicago and other 
cities, police and health inspectors surveyed samples of homes or fac- 
tories [12]. In the depression of 1914-15, many surveys of unem¬ 
ployment were made, notably by canvass of the workers insured by the 
Metropolitan Life Insurance Co. through its agents in 29 cities [13] and 
by canvass of 104 city blocks and 3703 additional tenement houses by 
the Bureau of Labor Statistics using about 100 tenement house inspec¬ 
tors. Both agencies repeated their surveys in New York City eight 
months later [14]. 

. In the depression of 1921-22, somewhat similar methods were used to 
estimate unemployment and,- in general, whHe the results were far. from 
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satisfactory, there was improvement in the identification of the unem- 
ployed as distinct from other needy groups and increased detail in the 
information collected. Especially noteworthy as an advance beyond 
previous practice was the survey conducted in Columbus, Ohio, by 
Frederick E. Croxton and Mary Louise Mark using 100 university 
students to canvass three districts within the city selected by the presi¬ 
dents of the Federation of Labor and the Chamber of Commerce as a 
‘‘fair sample of the wage-earning population of the city’' and including 
approximately 10 percent of the wage-earning population. The survey 
was repeated annually from 1922 to 1925 [15]. A similar procedure 
was used in Philadelphia by J. Frederic Dewhurst and Ernest 
A. T u p p e r who had school attendance officers canvass 166 small dis¬ 
tricts selected to provide an accurate cross-section of unemployment [16]. 
This survey was repeated annually during the 30’s and provided 
several kinds of data not previously available. The Columbus proced¬ 
ure was used in 1929, 1930, and 1931 in Buffalo, N.Y. by Croxton [17] 
and in 1931 in Syracuse, N.Y. by John N. W e b b [18]. 

Amohg numerous health surveys made in the U.S. from time to time, 
several examples may be mentioned that resemble the |)receding surveys 
in their methods of sampling. In 1921, the U.S. Public Health Survey 
selected Hagerstown, Md., as a conveniently located and “fairly typical 
small city in the east not greatly influenced by immigration” in which 
to study sickness and fertility by periodic visits to a sample of house¬ 
holds [19]. In 1929-30 the Committee on Costs of Medical Care made 
many sample studies, including one on the incidence of illness among 
9,000 families [20]. The U.S. Public Health Service and Milbank 
Memorial Fund studied sickness among those elements of the popula¬ 
tion that had borne the brunt of the depression by selecting severely 
effected districts in 10 localities, omitting the slums, Negro, and well- 
to-do sections [21]. 

(d) Public Opinion Polls: The practice of surveying public opinion 
emerged from simple but obscure beginnings in the “straw vote” con¬ 
ducted by newspapers to sense public reactions to candidates and obtain 
human interest stories by interviewing the “man in the street.” Even 
before 1900 the New York Herald collected pre-election reports and esti¬ 
mates from all over the United States and attempted to forecast the 
outcome of elections. In 1904 it polled 30,000 registered voters in New 
York City. In 1905 the Chicago American and Chicago Journal took a 
poll during the mayoralty campaign and the Columbus Dispatch started 
a long Series of polls by taking one in the state election of 1906. In 1912 
papers in Boston, Chicago, Cincinnati, Denver, Los Angeles, and St. 
Louis conducted a nation wide poll in 37 states. Four years later, this 
gtonp of papers repeated its presidential election poll and another pdLl 
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was taken by the Hearst newspapers. The Rexall drug store chain 
took a nation wide poll in 1920 using its stores as centers to collect the 
ballots. These and other efforts were outdone in size by the Literary 
Digest which started polling in 1916 and in 1920 mailed out 11,000,000 
ballots to persons whose names were taken from telephone directories 
and other lists. Two years later it conducted a poll on prohibition. 
Other polls were taken at the rate of about one every year and a half. 
R*o b i n 8 o n found that more than 86 straw polls were taken in the 
presidential campaign of 1928. Although these polls employed quite 
crude methods, they were successful in many instances because a moder¬ 
ate error only affected the prediction of the winning candidate when 
the election was close and because among many attempts some might 
be expected to turn out well. The sources of error in straw polls were 
analyzed in detail by Robinson in 1932 [22]. 

Closely related to the polls were market research studies and consumer 
surveys conducted by business concerns, publications, and advertising 
agencies. The results and methods of these studies received less publi¬ 
city than the polls but they offered even greater Opportunities for 
sampling than the straw votes. There was also a growing interest in 
public opinion research among political scientists, sociologists, and 
others which led to scientific interest, in the improvement of the tech¬ 
nique of opinion polling [23]. 

The foregoing discussion was limited to uses in which the sampling 
methods were quite simple, indeed often crude and inefficient, and not 
based on explicit considerations of probability. The dividing line is not 
sharp between them and some of the other surveys that will be included 
in later sections but they represent fairly well the pioneer stage in the 
emergence of modern sampling practice. This stage might also be illus¬ 
trated by examples of experiments, surveys, and studies in other fields 
in which sampling in some form was used. 

While, in these early instances, the sampling procedures were simple 
and usually employed uncritically with no great attention to accuracy 
and representativeness, it should be noted that the problems of obser¬ 
ving and recording data were almost always far more serious than the 
problems of sampling. Modern sampling procedures, had they been 
available and had they been applied effectively, would have permitted 
the use of smaller samples and made possible in most cases more careful 
fieldwork. Through these developments and those in other fields of 
statistical study, there arose a great opportunity for the use of better 
sampling procedures that has been exploited only in part up to the pre¬ 
sent time. 
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IV. DbVELOFMBNT OB THB USB OF THE 

SiMPLBB Random and Systematic Samplxnq Techniques 

Much of modern sampling practice rests on processes of selecting 
individuals at random or according to certain systematic procedures. 
These processes may be employed as providing a simple method for selec¬ 
ting a sample or they may be used as parts of a more complex sampling 
scheme. 

Random sampling utilizes the devices of games of chance or other 
methods that assure to each unit in the source from which the sample is 
drawn, an equal probability before the draw that it will be included in 
the sample; It has the advantage of facilitating certain applications of 
the theory of probability to the analysis and use of the results. 

Although the theory of probability was well established in the eight¬ 
eenth century, its applications to the practical drawing of samples were 
delayed until the twentieth. Applications to games of chance and lot¬ 
teries can be excluded from consideration since they were not concerned 
with estimating the characteristics of a population from a sample. Like¬ 
wise, applications to the interpretation of data as having been produced 
by a random sampling process from a hypothetical universe can be ex- 
eluded since they did not involve the actual practice of drawing samples. 
Also trials with dice or cards designed to “verify” known probability 
laws or merely for expository purposes are not examples of sampling 
practice. Doubtless there are many instances that have escaped the 
author’s notice, but the earliest instances he has found are B o w 1 e y’s 
sampling of a list of bonds and thear interest rates in 1906 using the final 
digits in one of the tables in the Nautical Almanac to make the random 
selection and Student’s testing of the ^-distribution in 1907 by drawing 
cards from a large receptacle. Random sampling was facilitated by 
T i p p e t t’s tables of random numbers, published in 1927 [24]. The 
practical importance of random selection slowly gained recognition, 
especially in connection with more complex procedures that were deve¬ 
loped after 1920 and will be discussed in the next section. 

• Systematic sampling employs a simple rule of counting cases in some 
convenient order and selecting for the sample every w’th case, or of 
using some similar pattern of selection such as taking material at 
measured intervals or drilling samples out of a large mass of metal by 
use of a template that locates the holes. More complex rules or patterns 
may be used and the starting point may be selected by a random choice 
or special rule. The theory of probability can also be applied to the 
results of systematic sampling under certain conditions. Bowley and 
others have interpreted it as a case of stratified random sampling and 
estimated sampling errors accordingly. 
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Systematic sampling has long been in use in taking samples of ore 
from the face of a vein in a mine or samples of metal from a pig or ingot. 
The practice of “cruising” a forest and sampling trees at uniform inter¬ 
vals has been well established in forestry for many years [25]. 

Systematic selection was utilized by A. N. K i a e r in his survey of 
Norwegian workers in 1895. As a means of facilitating special tabu¬ 
lations from census schedules, it was used in a study of family data in 
the 1900 Norwegian census, a study of marriage in the Danish census of 
1901, and a housing study for Oslo in 1913-14 [26]. 

Kiaor’s work apparently had little influence on surveys in the U.S. 
or in Europe. Apart from the discussions he initiated in the Bulletin of 
the International Statistical Institute from 1896 to 1903, it was men¬ 
tioned only briefly by E d g e w o r t h in his Presidential address before 
the Royal Statistical Society in 1912 and in the U.S. by W. B. 
Bailey and P. S. C h a p i n in 1906 and 1920 respectively [27]. 
It had a greater effect in certain continental surveys [28], 

In 1909 Bowley. included a brief chapter on Sampling in his Elemen¬ 
tary Manual of Statistics making general references to sampling in com¬ 
merce, mining, and industry, but not to specific sample surveys. How¬ 
ever, in 1912 he took every twentieth working class household in Reading 
in a study of poverty and his associates did the same for three other 
cities in 1913 [29]. He computed probable errors of sampling and 
recognized other sources of error in the interviewing, definitions, and 
process of estimating. This study was followed by a systematic samp¬ 
ling of census schedules in 1915, and by similar surveys of Liverpool 
(1930) and Merseyside (1931) by Caradog Jones, Southampton 
(1927/) by Fo r d, and London (1929) by the London School of Econo¬ 
mics under Bowley’s direction [30]. 

John Hilton made a series of studies of workers in the unemploy¬ 
ment insurance system beginning in 1923 [31]. They were selected 
systematically from the files of the Labour Exchanges. In addition 
to the information in the records some data were obtained by interview? 
ing workers who came to the exchange. Certain deviations from 
strictly systematic selection introduced biases which were reduced by 
subsequent improvements of the method. Hilton found a sample of 
only one percent quite satisfactory to meet the practical administrative 
and policy-making purposes for which the studies were made. The 
reduction in expense that resulted from sampling such a small propor¬ 
tion of the records was indeed impressive. Oddly enough the method 
was not imitated to any great extent by other government bureaus. 

Another example of the great usefulness of sampling to get quick 
inexpensive tabulations was furnished by the Japanese who tock a sam¬ 
ple of one in 1,000 from their 1920 census to get data quickly after the 
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earthquake of 1923 [32]. Subsequent checking when the usual tabu* 
Rations were completed verified the accuracy of the sample results. Fur¬ 
ther examples of sampling census schedules for special tabulations are 
Day M o n r o e’s study of Chicago families in the 1920 Census and 
R.F. G e o r g e*s study of British workers in the 1931 Census [33]. 

In spite of this successful experience, the use of random and systematic 
sampling procedures in statistical work made slow progress. At the 
Rome Session of the International Statistical Institute in 1925 a reso¬ 
lution was adopted recommending the use of sampling for statistical 
purposes with appropriate precautions as to its representativeness, mathe¬ 
matical statement of the precision, and full description of the methods 
employed. The reports that were submitted by the commission that 
drafted the resolution presented evidence of the usefulness of sound 
sampling procedures but both the reports and the resolution had less 
immediate effect on statistical practices than might have been expected. 
Eight years later, in 1934, N e y m a n revived the discussion of these 
reports in a notable paper before the Royal Statistical Society. 

In America, serious attention was given to problems of sampling 
methodology by several committees of the Social Science Research 
Council. There was a strong current of interest among the sociologists 
including Chaddock, Ross, Ogburn, Stouffer, Lund- 
b e r g, Dorothy Thomas, Stephan and others [34]. Mar¬ 
garet H. H o g g, who had worked under Bowloy^s direction on some of 
the British surveys, came to America to the staff of the Russell Sage 
Foundation and there made a critical study of employment and unem¬ 
ployment statistics. In an article in the Journal of the American Statis¬ 
tical Association she made a strong plea for rigorous methods of sampling 
and cast doubt on the value of surveys such as those that had been 
made in Philadelphia and Buffalo, in which the sample was selected by 
judgment rather than random procedures. She was equally concerned 
about the adequacy of the classification of workers into the various 
categories of employment and unemployment and the analysis of the 
data in terms of significant questions. In the spring of 1931 Miss Hogg 
made a survey of unemployment in New Haven, Connecticut, partly 
for the purpose of testing the practical difficulties of applying a random 
sampling method and also developing better schedules and statistical 
categories for unemployment surveys [36]. 

Two very important general developments affecting the use of sampl¬ 
ing in the United States occurred in 1933. One was organization of 
large scale work projects for the unemployed under the national pro¬ 
grams of the Federal Emergency Relief Administration (1933-35), Civil 
Works Administration (1934-35), and Work Projects Administration 
(1936-40). The second was the enlistment of many leading statisticians 
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from the universities and business in the reorganization of government 
statistical work and administration of emergency agencies [36]. The 
statistical needs of the government increased tremendously as it took 
active steps to meet the problems of the depression and undertook vari¬ 
ous New Deal programs. Since the American statistical system is de¬ 
centralized, it became necessary to establish a Central Statistical Board 
to coordinate and regulate the statistical activities of many agencies 
engaged in collecting data for their own purposes or for general use. The 
Board was largely an outgrowth of the Committee on Government Sta¬ 
tistics and Information Services, an advisory group organized by the 
Social Science Research Council and the American Statistical Asso¬ 
ciation at the request of the Secretaries of Agriculture, Commerce, In¬ 
terior, and Labor to assist them in overhauling the statistical work of 
their Departments. 

The great variety of statistical work done by the regular agencies, 
the National Recovery Administration, and other emergency agencies 
far exceeds the scope of this paper. Only a few large scale surveys can 
be described briefly as examples of those of their projects that were 
based on sampling; many smaller and more 8i)ecialized studies were 
also undertaken. A number of difficulties prevented these projects 
from embodying fully the best sampling procedures then known and 
from exhibiting the range of uses to which sampling methods could be 
put. Most of the work was started with inadequate time for planning 
and preliminary trials. There were, curiously enough in a period of 
unemployment, severe shortages of persons technically competent to 
supervise the work. Moreover the field workers and office staffs were 
drawn largely from the unemployment relief lists and worked under 
restrictions as to hours and rates of pay. In spite of these difficulties 
the results contributed greatly to many very important programs and 
provided detailed statistical information where there had been little or 
none before. 

(1) The Financial Survey of Urban Housing was taken in conjunc¬ 
tion with the Real Property Inventory, a complete canvass of housing 
in May 1934 covering 60 cities. The Financial Survey wasi taken by 
interviewers who visited all the families in one block out of every ten 
in larger cities and one in seven in smaller cities. Additional schedules 
were obtained by mail from families in another four blocks out of ten. 
The survey resulted in a 1200 page report of detailed financial data and 
was unique as an early instance of the use of sampling procedure for 
obtaining special information as part of a single complete canvass [37J. 

(2) A series of research studies of workers on relief and related sub¬ 
jects were undertaken by the FERA and WPA in selected cities and 
counties from 1933 to 1940 using a variety of methods and samples. 
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The looallties were selected in part by judgment of their representative¬ 
ness of different types of situations that were to be compared, in part 
by administrative considerations of availability of supervisors, non¬ 
interference with other projects, etc. Systematic sampling was used 
extensively within the localities for many of these studies and the sam¬ 
ples were appraised critically in the reports. One of the studies was 
an 11 percent national sampling of workers on relief in March 1935, with 
proportions varying from state to state, providing very detailed tabu¬ 
lations by age, occupation, and education. The accuracy of the sample 
results was verified by comparison with subsequent complete tabula¬ 
tions and a table of sampling errors was given [38]. 

(3) The Study of Consumer Purchases was conducted in 1935-36 by 
the Bureau of Labor Statistics in 32 cities and the Bureau of Home 
Economics in 19. small cities and 206 villages or rural counties [39]. 
The study was a work relief project and other agencies participated in 
the planning and analysis. In selecting the localities, available data on 
their economic characteristics were used to achieve a high degree of re¬ 
presentativeness; within each locality families were selected systemati¬ 
cally from city directories, the schedules of the Real Property Inventory 
(New York City), the 1934 WPA Census of Chicago, and similar lists. 
The smaller areas were canvassed completely. From the first simple 
schedules obtained for 783,000 families a second sample was selected for 
interviewing about details of income and expenditures. This sample 
was designed to provide adequate numbers of families in certain rela¬ 
tively rare categories without taking more families in the more prevalent 
categories than were needed for comparisons between the various types 
and kinds. The sampling procedure was compL'cated by the necessity 
of interviewing in such a manner that if the work were terminated at any 
stage in the process families that had been visited would still be a re¬ 
presentative sample. This project far exceeded any previous study of 
its kind in size and complexity. The procedures and problems have 
been described rather fully in the reports and elsewhere. They follow a 
basic plan that was prepared by the Social Science Research Council 
in 1929 [40]. 

(4) The National Health Survey was conducted by the U.S. Public 
Health Service in 1935-36. It covered 83 cities in 18 states with 
sampling ratios varying from 1 in 38 for New York City to complete 
canvass of the smaller places. The sampling was done by dividing each 
city into small areas of less than 1,000 persons each using the 1930 Census 
enumerators’ maps as the basis, and then drawing a systematic sample 
of these small districts for complete canvass. The Survey supplied a 
great amount of data on illness and medical care. Its schedules were 
also tabulated in great detail by the Social Security Board to obtain 



cross classified information about family composition and characteristics 
for actuarial studies. 

(6) The Michigan Census of Population and Unemployment was 
taken early in 1935 by the State Emergency Welfare Relief Commission 
as a WPA work relief project [41]. The sampling procedure involved 
complete enumeration of all cities between 3,000 and 40,000 inhabitants 
and a 20 percent random sample of smaller places and rural townships. 
Cities of more than 40,000 inhabitants were sampled by taking all dwell¬ 
ings with certain predesignated house numbers according to a scheme 
developed by S. A. StoufFer. The reports not only provided detailed 
data on unemployment in various parts of the state, but also unusual 
information on migration that was subsequently analyzed by John 
N. Webb and Albert We Stef eld [42]. 

(6) The Minnesota Income Study was a work relief project sponsored 
by the Minnesota Resources Commission and operated in 1938 and 
1939 using a complete system of stratified sampling with a systematic 
selection of two-square-mile areas in rural districts [43]. 

(7) The New York City Youth Survey was made by the Welfare 
Council of New York City in 1935 taking every hundredth household 
from the lists of the 1934 Real Property Inventory supplemented by a 
similar sample of dwellings built after the Inventory [44]. It was also a 
WPA work relief project. All members of these households between 
16 and 24 years of age were interviewed about their leisure activities, 
employment, schooling, and other personal data. 

(8) The Continuous Work History Sample is a four percent sample 
of workers covered by old age insurance maintained by the Social 
Security Board in connection with its records of earnings and contri¬ 
butions to the insurance scheme [45]. Beginning with 1937 all reported 
earnings and related information are compiled for this group of workers. 
They were selected by use of certain combinations of digits in their account 
numbers. The sample provides annually distributions by age, sex, race, 
and taxable wages that are needed for actuarial purposes as well as useful 
for general economic studies. 

(9) The 1937 Enumerative Check Census of Unemployment was 
conducted by the Director of the National Unemployment Census who 
had been ordered by an act of Congress to undertake a voluntary census 
of the unemployed by mail [46]. The Check Census was designed to 
determine what proportion of the unemployed had actually registered 
and thereby provide more accurate estimates of the volume of unemploy¬ 
ment than had been available previously; The sample was a systematic 
selection of all households in two percent of the postal carrier routes in 
the U.S.A. About 18 percent of the population, not served by carrier 
delivery, was excluded but was taken into account in the estimates;. 
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The 510,000 households in the sample were visited by postal carriers 
to obtain da^ on employment and unemployment and a special count 
was made of the number of workers and unemployed persons for 
the routes that constituted the sample. From these data it was deter¬ 
mined that 71 percent of the unemployed had registered and estimates 
were prepared for separate classes of workers with corresponding cal¬ 
culations of the sampling errors of the estimates. The analysis of the 
estimates and their errors was especially noteworthy. 

These examples have brought us up to the point at which we approach 
developments that wiJl be discussed by other speakers on this program. 

The foregoing examples exhibit progress in utilizing sampling tech¬ 
nique for statistical surveys of exceedingly important national problems. 
They reflect the trend toward greater use of detailed statistical data and 
research as a basis for determining policies and establishing programs 
on a city and state wide basis as well as nationally. They are impres¬ 
sive for the size of the samples taken, but there were also many smaller 
samples of comparable importance. In two ways, they were a result of 
the depression: (a) in the urgent demand for statistical data genera¬ 
ted by the emergency and by the New Deal programs, and (b) in the 
funds and relief i)orsonnel that were made available. However, these 
influences tended toward haste and inadequate preparation, toward the 
use of less efficient sampling schemes in order to meet problems of super¬ 
vision and the restrictions on expenditures for travel by interviewers 
and toward types of inquiries that were suitable for the kinds of inter¬ 
viewers that were available. Problems of cost and economical opera¬ 
tion were considered but were affected by the primary purpose of pro¬ 
viding useful work for unemployed white collar workers. This tended 
to discourage intensive analysis or research studies not of a relatively 
routine character since the amount of employment provided in relation 
to the kind and amount of supervision required was smaller for such 
project. Finally sampling problems received only secondary emphasis 
because the other problems connected with the survey were much 
more serious and time consuming. The results of these surveys were of 
very great value and to a large extent this was due to the use of sampling 
procedures. 

Coupled with the direct effect of depression problems in stimulating 
the use of sampling was the trend of thinking among statisticians and 
social scientists who, during the late 20’8 and early 30’s, became increas¬ 
ingly interested in applying error theory to the analysis of time series 
and other data [47], This trend of interest was well represented among 
many of the men who participated in the work of the Committee on 
Government Statistics, and recommended in 1933-35 greater and better 
uw of sampling procedures in government statistical work for such 
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j>urpo8es as (1) checking the coverage, accuracy, and completeness of 
censuses, (2) testing the representativeness of current reporting systems 
(crops, cost of living, payrolls, employment, production, etc.), (3) supple¬ 
menting the regular schedules in censuses to relieve them of overload¬ 
ing, (4) obtaining prompt national and regional figures on such sub¬ 
jects as unemployment, and (5) making very detailed intensive studies 
in which the emphasis is on the analysis of relationships [48]. The Commi¬ 
ttee also recommended that the staff of the Central Statistical Board 
and the Bureaus of Agricultural Economics, Census, and Labor Statistics 
include expert advisers on sampling procedure whose formal professional 
training in the technical phases of sampling was comparable to that of 
chemists, physicists, or biologists in the government service. These 
agencies did move to accomplish what had been recommended. They 
experimented with trial surveys of unemployment, agriculture, construc¬ 
tion, retail prices, and basic studies of the problems involved in deve¬ 
loping practical sampling systems [49]. 

By this time sampling practice had outgrown the simpler methods of 
random and systematic sampling and was developing complex sampling 
systems specially designed to fit the nature of the population that was 
being sampled, the costs and administrative factors, and the principles 
of efficient design that had evolved in scientific experimentation and 
industrial production. 

V. Experimental Comparison of Methods 
AND Development of Complex Sampling Pbocbdubbs 

Modern sampling practice utilizes a variety of devices and methods 
which have been tested experimentally and incorporated into sampling 
theory. The aim of modern practice is to select those methods which, 
when combined in the most appropriate manner, will constitute a samp¬ 
ling system that is economical, convenient, and accurate in the situation 
for which it was designed. Among the devices available for the cons- 
truction of such a sampling system are: (a) the technique of selecting 
items at random, (b) the determination of the kind of sampling unit 
that will have the-most desirable properties, (c) subdivision or strati¬ 
fication of the population in an advantageous manner, (d) the use of 
variable sampling proportions, (e) subsampling and multistage sampling 
in which the sample is itself sampled in turn, (f) drawing two or more 
units from each ultimate subdivision to permit estimation of the sampling 
error from their differences, (g) use of information provided by variables 
that are correlated with the one that is being studied, and many other 
procedures. 

It is difficult to find the original source of many of these techniques 
but it is clear that they were, to a large degree, crystallizations of notions 
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suggested by common sense, customary practice, and practical problems 
encountered in sampling. Discov^y of their importance and success 
in Combining them into efficient sampling schemes has required a clear 
understanding of their properties and a considerable amount of ingenuity. 
Beyond that, careful experimentation has been necessary to test their 
relative merits under various conditions. Their development has occurred 
primarily in connection with agricultural experimentation; mass pro¬ 
duction industry; and large scale surveys. 

(a) Agricultural experimentation,: One of the first steps in the ex¬ 
perimental comparison of sampling schemes was the study of hetero¬ 
geneity in the fertil'ty of a field and the consequent correlation of ad¬ 
jacent portions. In 1910 and 1911 very important work was reporced 
by “Student,” Wood and Stratton, and Mercer and Hall, [60], 
leading to the conclusions that in field trials there is always some experi¬ 
mental error, that it can be reduced by taking a large number of small 
plots and that, in the comparison of two varieties or treatments, it can 
be reduced by taking these plots in pairs, adjacent to each other, and 
using one plot out of each pair for each variety or treatment. The latter 
device was adopted so as to take advantage of the correlation between 
adjacent areas. Plots of different sizes and shapes were compared 
using the results of a careful harvesting and measurement of mangolds 
and data on 400 reports of duplicate plots reported by other investigators. 
These results led to similar experiments in England, America, and else¬ 
where [51]. Various systematic sampling schemes were proposed and 
tried experimentally, both for locating plots and subsampling the plots 
in order to reduce the labor of harvesting them completely. In 1929, 
G1 a p h a m and W i s h a r t published the results of experimental 
comparisons between certain random and systematic methods of samp¬ 
ling a field of potatoes or cereals and analyzed the factors that contri¬ 
buted to the error of the estimate of yield [52]. In the same year Smith 
and Prentice published results of a field study in which they took 
samples of soil and then subsampled for laboratory examination. In 
their analysis of the results they estimated the increase in error due to 
subsampling [63]. R. A.Fisher, whose advice and methods of statis¬ 
tical analysis had been followed in many of the experiments in the 20*s 
and later, developed complex systems of experimentation of great 
efficiency and revolutionized experimentation [64]. Yates and 
' Z a c o p a n a y published in 1936 a thoroughgoing analysis of the effi¬ 
ciency of sampling a field including comparative labor costs [66]. A 
number of manuals were published expounding the principles and prac¬ 
tice of field experimentation. This work of the agronomists and statis- 
' ticians had direct applications to large scale surveys. 
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; (6) productiou industry; Another source of complex sampling 

procedures was the development of inspection and quality contrpl in 
mass production. In 1923, engineers at the Western Electric Com¬ 
pany, manufacturers of telephone equipment, began to apply probabi¬ 
lity theory to the inspection of telephone exchange equipment. In the 
refinement of manufacturing processes and progressive adoption of more 
rigorous specifications, the cost of inspection had become very burden¬ 
some and sampling procedures offered possibilities of reducing the amount 
of inspection without serious loss of control over the quality of the pro¬ 
duct. Different sampling schemes were compared on the basis of their 
probability of acceptance curves and tolerances were established for 
the proportion of defective pieces in a lot. Thereafter sampling procedu¬ 
res were developed in more complex forms to achieve a reduction in 
the amount of inspection to the minimum necessary under the condi. 
tions of manufacture and the specifications to be met [56]. Technical 
problems more or less peculiar to the telephone industry made it the 
pioneer in the applications of mathematical st^^tistlcs to industrial pro¬ 
cesses, including not only inspection but quality control and probabi¬ 
lity analysis of operating problems under Shewhart, Dodge, 
Molina, Fry, and others [57], 

(c) Communication of ntv> techniques: These developments in agri¬ 
culture and engineering had both direct and indirect effects on sampling 
survey pract ce. They provided principles of design and contributed to 
the growth of applied mathematical statistics. Still there were many 
practical problems and obstacles that delayed the immediate extension 
of the methods developed for field trials and manufacturing to large 
scale surveys. One of the obstacles was the relative lack of communi- 
cation between statisticians engaged in different types of work. An 
important step toward facilitating communication was taken by the 
Royal Statistical Society in 1933 when it formed the Industrial and 
Agricultural Research Section and published the proceedings of meetings 
of the Section as a Supplement to the Society's Journal, The Section 
brought together mathematical statisticians, engineers, agriculturists, 
and others interested in practical applications of newly developing sta- 
tistical theory and stimulated greatly interest in sampling. E. S. 
Pearson presented a notable paper on “Problems of Inaustrial Samp- 
ling'' at a meeting of the Section early in 1934 [58]. A few months later, 
Jerzy Neyman read before the Society a comprehensive theoretical and 
critical paper on stratified sampling and purposive selection. He cited 
among several examples, a survey of the working population in Poland 
for which he had designed a stratified random sample of districts [59] i 
A number of other papers by various authors, published from time to 
time in the Supplement, included discussion^ of sampling practice, 
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In tliis period interest in sampling practice was heightened in Great 
Britain by She wharfs visit in 1932 (a factor in the formation of the 
Industrial and Agricultural Besearch Section) and in America by the 
visits of Fisher, Neyman, Yates, and Cochran (1936-38) as well as 
by American students who studied in England. 

{d) Large-scale surveys: Another root of complex sampling practice 
is to be found in the progressive improvement of large scale surveys of 
erop yields and acreages, the labor force, and other economic and social 
facts. A pioneering survey in India in 1923 by J. A. H u b b a c k went 
almost unnoticed until Mahalanobis discovered and republished 
it in 1946 [60]. Hubback undertook to estimate the yield of rice by ob¬ 
jective measurements in the fields instead of by the methods based on 
the judgment of farmers and brokers. He used as sampling units very 
small areas measured off by a wooden frame in every field his agents found 
being harvested as they walked a fixed route from each selected center. 
Hubback was acquainted with Student’s and Bowley’s sampling work. 
His report emphasized the advantage of random selection of many very 
small areas as economical and necessary to obtain a valid estimate of 
error. 

In the period 1928-31, J. O. Irwin examined the British crop esti¬ 
mating system and made recommendations for improving the sampling 
methods [61]. Subsequent work was done by Cochran. In the United 
States, W. F. C a 11 a n d e r, J. B. Shepard, C. F. Sarle and others 
began to plan in the late 20’s for a sample of farms to be used for various 
studies of acreage, production, livestock, etc. Sarle made comprehen¬ 
sive appraisals of the methods used to obtain farm-price data in 1927 
and crop-yield estimates in 1932 and proposed a program of studies 
aimed at testing and improving the various sampling operations then 
in use [62], Several studies of this type were made by state agricultural 
statisticians. 

In July 1936, the Bureau of Agricultural Economics and Iowa State 
College held a conference on sampliilg attended by many of the state 
' agricultural statisticians as well as staff from Washington and Ames [63]. 
R, A. Fisher who was lecturing at Ames participated in the discussions. 
The conference set forth a great variety of practical problems and out- 
liiied specific projects for research to help solve them. Some of these 
projects were started at Ames in cooperation with the Bureau, some 
were undertaken in Washington. The pi*ogram has been continued up 
.to the present time with additions and modifications. It has resulted 
in a remarkable series of reports and developments of methodology [64] 
M weU as the establishment; of a sampling staff within the Iowa State 
College Statistical Laboratory at Ames under G. W, S h e d e c o r, A^. 

1Citig, and B.J. Jessen, 
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During the same period, P. C. Mahalanohis and his associates at the 
Indian Statistical Institute in Calcutta developed large scale sampling 
methods to a high degree of technical perfection and utilized them for 
surveys of jute acreage, agricultural finance, famine conditions, radio 
listening, and many other subjects. The theoretical system associated 
with these practical applications has been set forth fully by Mahala- 
nobis in his publications and . lectures [65]. Mahalanobis has made 
careful experimental measurements of the human errors in sampling 
surveys by use of “interpenetrating samples” and other means. 

Prom 1936 on the Research Division of the U.S. Bureau of the Census 
under C. L. Dedrick made extensive studies of problems in popu¬ 
lation sampling, utilizing the 1930 Census returns. The results have 
not been published. In 1939, Stephan, D e m i n g, and Hansen 
designed a sampling scheme that was used in the 1940 Population Census 
to draw a 5 percent sample totalling 7 million people. This method 
was based on experimental tabulations of 1930 Census data and on a 
variation of systematic sampling [66]. The sample was used to obtain 
preliminary estimates of regular census statistics as well as tabulations 
of the special questions that were asked only of the people in the sample. 
Subsequent complete tabulations verified the accuracy of the estimates. 

During the same period experiments were conducted in a number of 
cities and towns by the Research Division of the Work Projects Ad¬ 
ministration, under H. B. Myers and J. N. Webb, to teat out 
methods of conducting sample survey of unemployment. On the basis 
of these trials a monthly nationwide survey was started in December 
1939 utilizing a subsampling procedure in approximately 60 counties. 
Its scope was enlarged during the war to include housing and labor ques¬ 
tions and in 1942 it was transferred to the Census Bureau where it was 
developed further as the Monthly Survey of the Labor Force [67]. 

With the Monthly Survey and other sampling surveys required by the 
war agencies, the Census Bureau had a sizeable program of sampling 
work and developed, under Morris H. Hansen, a staff of sampling specia¬ 
lists who designed sample schemes, and studied their performance in 
practice. Data from the 1940 Census for very small areas were made 
available for use in sampling and Sanborn maps showing every street and 
building in a large part of the cities in the United States were ob¬ 
tained [68]. In addition airplane maps were obtained for a large part 
of the United States and procedures were developed for employing them 
in sampling. 

A further step was taken in the development of sampling facilities 
when the Bureau of Agricultural Economics established at Iowa State 
College in 1934, a project to design and prepare a Master Sample of farms 
for use in its surveys [69]. Thjs Master Sainple is a stratified selection 
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c#"yery sp^all apeaa basad <»i airplaiM^ photographs and highway maps. 
The Census Bureau joined in its deTelopment and had it extended to 
ineliide pther tjian farm areas. 

i This most recent developments in complex sampling procedures 
hafe been described very inadequately and many other recent deve¬ 
lopments have been omitted for want of space. Other speakers on the 
program will present the current stage of theory and examples of 
present day practice. 


VI. 1)kvbx.opmbnt or Use or Judombb* Selection and Controls 

IN SAMrUNQ 

All attempts to obtain data by sampling involve some choices based 
on the purposes of the study, knowledge of the material, and experience 
IVith the methods of observing and recording similar data in previous 
studies. For example Bpwley’s choice of Beading for his survey in 1912 
and Clapham’s choice of certain fields at Bpthamsted for his experiments 
on sampling design were not random selections. Yet the conclusions 
drawn from such samples as these are commonly generalized to apply 
to .other peripds of time and other places. Some investigators have de¬ 
pended entirely on .their knowledge and judgment to make the final 
selection of the items that constitute the sample, others have insisted 
ibat judgment should only be used to subdivide the population into 
Strata and units of sampling, the actual choice of the sample being made 
at random. These views have been presented in various forms and the 
difi[er€nces have not yet been fully resolved. Research is in progress 
to determine some of the facts and develop the principles that are invol¬ 
ved in appraising the performaijee of various sampling procedures based 
on these confiicting views. 

Jensen, in his report in 1926, described a number of surveys made 
by “purposive’’ sampling in which districts were selected which, taken 
together, matched the population in certain characteristics known from 
a previous census. The theory of purposive selection was developed 
by Bowley in 1926, and discussed by Jensen in 1928 [70]. Neyman 
compared purposive and stratified random sampling in 1934 giving 
special attention to experience reported; by G i n i and G a 1 v a n i. 

a n g u s described a variety of purposive sampling of counties used 
in studies of the FERA in 1934 [71]. 

The development of public opinion polling and market research in¬ 
volved many interesting problems of social psychology and survey pro¬ 
cedure that fall outside the scope of this paper, but it also led to the 
use of many different sampling schemes prominent among which were 
those termed “quota contrbl” sampling. The earliest work was done 
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‘With samples chosen to meet the cont^enience and very limited resources 
of the research personnel. In this respect they were like most other sur¬ 
veys conducted at the time. Robinson has reviewed in detail the history 
of straw votes and opinion polls to 1932 [72]. He also analysed the 
Literary Digest poll which, in spite of its great size, was badly biased by 
its method of mail balloting. Several analysts were able to improve the 
Literary Digest results by relatively Simple adjustments, [73] but, in field 
surveys in which interviewers are left free to use their judgment 
in selecting a representative group of respondents, a better procedure 
appeared to be to regulate the selection of the sample by assigning to 
each interviewer a quota of persons of various kinds so as to obtain the 
correct proportions of men and women, old and young, rich and poor, 
etc., in each city or district that was canvassed. This procedure was 
developed by Chering ton, Roper, Qallup, Crossley, 
whose sampling surveys of opinion became widely known after the elec¬ 
tion of 1936, and by market research and opinion survey organizations, 
whose studies received less publicity [74]. The general principles of 
these and related methods have been discussed by Brown, Franzen 
and Robinson, by C a s s a d y, and in two symposia [75]. Quota 
methods have been employed in the surveys of the National Opinion Re¬ 
search Center [76], the Office of War Information and the British War¬ 
time Social Survey [77]. Most of the opinion polls and market re¬ 
search studies around the World at present employ quota methods or 
related procedures of sampling. These methods have been adopted 
partly by imitation of the more Widely known surveys and partly be¬ 
cause they are attractive With respect to costs and practical convenience. 

VII. General View or the Present Period 

Current uses of sampling will be described by other speakers at this 
session. For the most part these uses were connected with the war 
which proved to be an even greater accelerating stimulus than the dep- 
ression of the 30*s. They included surveys of employment, housing, 
prices, shortages of consumer goods, dealer inventories, public reac¬ 
tion to wartime measures, characteristics of selectees, the attitudes of 
soldiers, effects of bqmbing in England, Germany and Japan, public 
opinion in many countries, inspection of election registers in Greece, 
surveys of saving and spending, employee attitudes, reading and radio 
listening, social and psychological factors affecting fertility in the U.S. 
and in Britain, etc. In manufacturing and procurement, sampling me- 
. thods were perfected for quality control and inspection of materials, 
r parts, and finished products. Market research and opinion studies by 
spirivate Research agencies, aaid buMness concerns developed rapidly, 
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with considerable emphasis on measuring^ public relations and employee 
attitudes. The volume of work increased and many continuing or re¬ 
petitive surveys were established, making it possible to spread the cos^ 
and hence devote greater resources to the design of each sample than 
had been possible for infrequent sampling surveys. 

Other speakers will describe the more recent developments that grew 
out of these earlier accomplishments. The Journal of the Royal Statist 
tical Society and its Supplement^ the Journal of the American Statistical 
Association, Sankhyd, the Annals of Mathematical Statistics and many 
of the scientific and professional publications in various fields have pub¬ 
lished the increasingly numerous articles that refiect the progress of 
applied sampling. The reader should review them, beginning in 1940 
or earlier, and search articles that report particular studies as well as 
those that are principally devoted to discussions of method. 

Great as these advances have been, they are only the forerunners of 
a broad expansion in the use of sampling in the future. Further im¬ 
provements in method are also to be expected. Much experimental 
work is being done both within and outside government bureaus. The 
Committee on* the Measurement of Opinion, Attitudes and Consumer 
Wants, appointed jointly by the National Research Council and the 
Social Science Research Council, is making a comprehensive study of 
sampling methods as they are used in its field. The United Nations 
Statistical Commission has established a Sub-Commission on Sampling 
which will contribute greatly to the development of sampling surveys 
in many countries. The International Statistical Institute can perform 
a great function in extending the use of sampling procedures in the many 
statistical activities throughout which it exerts its leadership and 
influence. 


Notes and References 
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Rimtni 

Les premiers exemples d’enqufites par sondage ont 6t6 d^crits dans 
des aper9us historiques par Jenaen^ Westergaard et autres auteurs. La 
conception d’une m6thode “representative** distincte d*un recensement 
odmplet) d’une part, et des Etudes partielles au moyen d*“enqu6tes*’ 
ou de “monographies**^ d’autre part» a 6t6 clairement mise en lumi^re 
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ill- 

au cours de la discussion d’une communication de Kiaer k la session de 
Berne de Tlnstitut International de Statistique en 1895. Les opinions 
furent extrfimement partag6es et, apr6s discussions aux trois sessions 
suivantes, Tlnstitut donna en 1903, sous reserve, son approbation k 
cette m6thode. 

Bowley recommanda vivement les enquetes par sondage dans un dis¬ 
cours en 1906, et utilisa le sondage syst6matique dans son etude du 
paup^risme dans quatre villes anglaises (1912-1913), et dans d’autres 
etudes. Des techniques de sondage syst^matique furent employees 
au Japon (1923), aux Etats-Unis (1927), et en Angleterre (1936) pour 
certains d^pouillements de bulletins de recensement. En Angleterre, 
des enquetes nationales sur le chomage furent men^s par sondage syst6- 
matique des fiches des Bureaux de Placement (1921-1928). Cette methode 
fut utilisee aux Etats-Unis (1931, 1934, 1935, 1937) dans des jenqu5tes 
sur le chomage, les budgets familiaux, les probl^mes de la jeunesse et, 
sous une forme sp^ciale, dans le recensement d^mographique et agricole 
de 1940. La th6orie du sondage systematique a 6te trait^e par Madow 
(1944), Cochran (1946) et par d’autres auteurs. La methode a et6 large- 
ment employe dans le sondage de minerals, de charbon et autres matiferes 
premieres, dans le contr61e de la qualite de produits manufactui68 et, 
comme un des elements de precedes de sondage plus complexes, dans de 
nombreuses enquetes agricoles et economiques. 

Bien qu’ayant ete trfes efficaces, les m6thodes systematiques n^ont 
pas donne entifere satisfaction pour certains buts. C’est pourquoi des 
methodes d’echantillonnage plus complexes furent elaborees, en parti- 
culier dans le domaine de la recherche agronomique. Le problfeme du 
choix de methodes de sondage qui permettent de tenir compte des diffi- 
cultes pratiques, du coOt et dc Texactitude, fut etudi6 a la fois experi- 
mentalement et theoriquement; des ameliorations dans les methodes 
utilis6es furent d6velop6es notamment dans des articles de Hubback, 
Fishert Clapham, Wishart, Yates, Cochran (1^22), Bowley (1926), Neyman 
(1934), Mahalanobis (1937), Sark, King, Jessen, et leurs collaborateurs 
(1938), Stephan, Deming, Hansen, et Hurwitz (1940), et de nombreux 
autres auteurs. Aux Etats-Unis, ces progifes sont dus, en partie, k une 
amelioration des donn6es de base, telles que specifications geographi- 
ques trfes detailiees des donnees de recensements, photographies aerien* 
nes, Tameiioration des cartes routiferes et plans de la propriete fonci- 
fere mis jour pour les nouvelles constructions. Les etudes du marche, 
d’opinion publique et certaines etudes sociologiques ont suivi un deve- 
loppement quelque peu different base sur une methode generalement con- 
nue sous le nom de “controle par quota” utilisee notamment par 
Roper, Oalhtp et CrossUy dans les etudes d’opinion publique qui depuis 
1935 ont donne lieu k un inter et general pour les sondages. 
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L’emploi des Bondages s’est beaucoup d4velopp6 pendant la depression 
de 1930 et pendant la guerre, les p^riodes de crise errant un besoin ur¬ 
gent de statistiques en de nombreux domaines et sous des formes nou- 
velles que la statistique traditionnelle n’est pas k meme de procurer 
en temps utile. 



SAMPLING OF HUMAN POPULATIONS 

by Morris H. Hansen 
Siatiatieal Assistant to the Director 
Bureau of the Census (United States) 

This paper is not intended to present any new results; its purpose is 
to review some methods of designing a sample that will yield estimates 
of the numbers that would result from a complete census of the popu¬ 
lation under consideration. Particular attention will be given to 
methods for obtaining a sample from a city or other local area. For ex-. 
ample, the problem might be to ascertain how many persons reside in 
an area, or perhaps what proportions of them have specified ages, em¬ 
ployment status, income, attitudes, or other characteristics. The pro¬ 
cedures involved in collecting the information from a particular indi¬ 
vidual are assumed to be the same whether the coverage is complete or 
on a sample basis. These procedures should be such that accurate and 
useful results would be obtained from a complete census using these 
piocedures. The results of such a complete census will be referred to 
as the ‘‘true"’ values of the quantities involved. 

The reliability of the results obtained from a sample survey depends 
not only on the size of the sample, but also and with equal importance 
on the sample design—that is, on the way in which the sample is selected 
and the wiiy in which estimates are prepared from the sample survey 
returns. Good sample design results from the effective use of available 
resources. Possible resources include not only such facilities as staff, 
maps, and tabulating equipment, but also statistical information and 
other knowledge of the population to be sampled, together with exist¬ 
ing sampling theory. While the methods to be employed will depend 
on the particular information desired, the fundamental sampling prin¬ 
ciples are the same for problems involving the estimation of character¬ 
istics of individuals, families, farms, business establishments, or other 
populations. 

It will be assumed that an acceptable sample design mast satisfy the 
following requirements. 

(1) The first requirement is that the design must be such as to pro¬ 
vide practical certainty that the estimate made from the sample does 
not differ by more than a prescribed amount from the value to be esti¬ 
mated, assuming that the procedures specified by the design are sub¬ 
stantially followed in the actual selection of the sample and in the com¬ 
putation of the estimate. In other words, the design used should bo 
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such that, in addition to making estimates of the desired characteristics 
from the sample, one can also derive from the sample itself or from prior 
knowledge measures of the precision of those estimates. A measure of 
precision will indicate the maximum error that may reasonably be ex¬ 
pected. This requirement is fulfilled if the selection of the sample 
is carried out in such a way that the probability of inclusion in the sample 
is known for each element in the population (farm, individual, or 
whatever is being sampled). 

(2) The procedures prescribed must be so simple and straightforward 
that they can be carried out substantially as specified within the time 
limits allowed and with the resources available. When such methods 
are used we can achieve in practice results that agree with the sampling 
theory. TJieory and practice are thus brought together, 

(3) From among the alternative designs which fulfill the two pre¬ 
ceding requirements, one should choose that design which will produce 
results of maximum reliability per unit of cost. Most of the recent ad¬ 
vances in the theory of sampling human populations and institutions 
have been directed at the accomplishment of this last requirement. It 
is this requirement that calls for locating and making effective use of 
available resources. Theory is not now available to guide one uniquely 
to the best method, but the available theory is exceedingly useful in 
guiding one to the choice of an effective method. 

It should be emphasized that for methods that fulfill the first two 
requirements mentioned above, the reliability of the results can be ob¬ 
jectively evaluated, and therefore does not depend on assumptions or 
judgment as to the representativeness of the sample. Samples that 
meet the above requirements will reflect a population as it is, taking 
account of changes that may have taken place in a population subse¬ 
quent to a census; and, moreover, methods that meet these require- 
* ments can be appLed to produce results of any desired precision by tak¬ 
ing a large enough sample even where no census of the population under 
consideration ever has been taken. 

Methods that do not meet these requirements and that are essentially 
expressions of judgment may be available at very low cost. Thus, sup¬ 
pose we want for the city of Washington an estimate of the proportion 
of dwellings that are owner-occupied. One way of estimating this pro¬ 
portion is to ask' someone whom we regard as well-informed on housing 
conditions to give us an estimate based on his judgment. This ap¬ 
proach might produce very accurate results, but experience indicates 
that it often does not. Even if the expert's judgment is good it is likel37^ 
that others to whom we may present the results will not share our con¬ 
fidence in the soundness of a judgment unsupported by adequate objec¬ 
tive evidence. 
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Instead of relying on the judgment of a single individual we might con- 
suit several such persons, and perhaps have them suggest representative 
neighborhoods of the city for us to investigate, or we might purposively 
choose “typical” families for interview. These methods still reflect 
the judgments of the persons choosing the sample. We might go fur¬ 
ther, and insist that the sample be selected in such a way that certain 
classes of families be.represented in the sample in proportion to their 
estimated numbers in the population being sampled, but with the 
final choice of the particular individuals to be included left to the judg¬ 
ment or convenience of the interviewers subject only to the restriction 
that ho must meet his quotas by classes of families. By thus increasing 
the number of sources of information, however, we have not essentially 
changed the logical basis for our confidence in the final estimate. The 
sample estimate is still dependent on the judgments exercised in the 
final selection, and we cannot evaluate objectively the soundness of 
those judgments. 

All of these procedures are rejected in the light of the requirements 
indicated above. The estimates resulting from these procedures lack 
the assurance given by methods for which objective measures of pre¬ 
cision can be derived. There is an advantage in having the more objec¬ 
tive information that is provided by random sampling methods, for the 
objective measures of precision that result mean that one can often avoid 
making erroneous decisions or choosing a wrong and perhaps costly 
course of action. Moreover, the statistical theory applicable to such 
methods not only provides measures of precision, but also guides one in 
the choice of efficient sample designs. 

Sampling theory has long been available for what we might consider 
the ideal circumstances for taking a sample. Most of you are probably 
familiar with the simple formula 



as the variance of a mean of a random sample, where n is the size of sam¬ 
ple used and cr^ is the variance of the original population from which the 
sample was drawn. The variance of a sample estimate provides a meas¬ 
ure of the precision of that estimate. Thus, one can be almost certain 
that with a moderately largo random sample the mean of the sample 
does not differ from the true mean being estimated by more than three 
times its standard deviation (the square root of its variance) computed 
according to the formula above. Not only does the above formula 
provide a measure of the reliability of the results of a random sample, 
but it also provides a basis for determining in advance of drawing 
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the sample approximately how large the sample should be in order to 
attain the precision required. 

The importance of the word “random** in this connection must not 
be overlooked. A sample is not random simply because the person 
selecting the sample is not conscious of any bias. Randomness must be 
deliberately introduced into the selection process by use of a table of 
random numbers or by some equivalent device. 

The simple formula given above, with a slight modification to take 
into account the finiteness of the population, will apply to samp¬ 
ling the population of a city if an unrestricted random sample of n 
persons is drawn from a list of the inhabitants of the city. If such a 
list were always available, and if considerations of cost did not enter 
into the problem of collecting information from the members of the sam¬ 
ple, there would be no need for further sampling theory. For most prac¬ 
tical purposes, a sample drawn from such a list would yield a smaller 
sampling error than a sample of the same size drawn by any other rea¬ 
sonable alternative methods. 

The need for investigating alternative methods of sampling arises 
from the fact that such lists usually are not available' and are too 
costly to prepare. Moreover, even were such resources available, there 
is no assurance that information can be secured from the entire sample 
by a reasonably inexpensive procedure. The reasonable alternative 
methods usually require a larger sample than the “ideal** procedure 
indicated above, if the same reliability is to be assured. But ordinarily 
the additional cost introduced by the increased size of sample will be 
small compared to the excessive costs and time required if the approach 
used involved the preparation of a complete and up-to-date list of all 
persons in the city and the interviewing of a sample drawn at random 
from such a list. 

Whenever a random sampling method is used a formula for the vari¬ 
ance of the sample estimate can be constructed. The formula will de¬ 
pend on"flie sampling procedure followed. Such formulas always involve 
the size of the sample, although not usually as simply as in the formula 
quoted above. Consequently, variance formulas provide a basis for 
determining the sample size required to achieve a specified, precision and 
for evaluating the precision from the sample* Moreover, if unit costs 
for the various operations involved in taking the survey are known, 
the unit costs together with the formula for the sampling variance pro¬ 
vide a basis for choosing the optimum sampling design—^that is, the 
design which gives the greatest precision for a given cost. 

While the preceding discussion may seem to point to the use of very 
complex procedures, yet the actual selection of a random sample can 
bd ..Telatively simple. A random sample can be drawn by any .of 
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a number of expedients, even with limited resources with which to 
work. 

Suppose, for example, we want to estimate the proportion of employed 
persons in a city and other similar characteristics. It is not essential 
to have a great deal of information or to introduce complicated pro¬ 
cesses in order to obtain a random sample of persons. Wo might have 
only a reasonably up-to-date map of the city which shows the street 
boundaries. The city map might be a published map, or an aerial pho¬ 
tograph, or a sketch of the block boundaries within the city. The only 
requirement is that the map be sufficiently accurate that individual 
blocks or other small areas can be identified in such a way that the field 
workei^s can locate exactly the areas that are selected. 

To obtain a random sample of blocks, one can first number the blocks 
serially. The blocks may be numbered in^any convenient sequence 
throughout the city. Assume for simplicity that it has been determined 
that for the design under consideration a sample of 500 blocks will yield 
an estimate of the proportion of employed persons with the required 
reliability. Of course, the size of the sample needed will depend on the 
accuracy required and on the method of sampling. 

If there are 5,000 blocks in the city, we can obtain a sample of 500 
blocks from among them by including in the sample one block in ten. 
One way of obtaining the random sample of 500 blocks is to draw 500 
numbers between 1 and 5,000 from a published table of random numbers 
and include in the sample the blocks having these serial numbers. A 
census of the selected 500 blocks would then be taken. The census 
would yield for the sample blocks both the total number of persons and 
the total number of employed persons, along with other desired infor¬ 
mation. An estimate of the proportion employed could then be obtained 
by computing the ratio of these two numbers from the sample. 

The above very simple procedure will yield results of measurable accu¬ 
racy, since in this particular instance each individual in the popu¬ 
lation has a known chance of being included in the sample. However, 
this procedure will often not be the best one for dealing with the problem. 
There are methods of modifying the sampling procedure which will 
ordinarily yield the required information from the sample at consider¬ 
ably less cost. 

A simple and inexpensive modification of the procedure for drawing 
the sample would be to introduce a certain amount of stratification in 
connection with the selection of the blocks. One obvious mode of strat¬ 
ification that can be readily imposed is geographical. Often there are 
fairly wide differences in some of the characteristics of persons living 
in different sections of the city and a geographical stratification will 
reduce the effect of these differences on the sampling error. 



nS INTERNATIONAL STATISTICAL CONFERENCES: I S I 

Such stratification is easily introduced if the blocks are numbered 
systematically, section by section throughout the city, instead of in 
an arbitrary order. With the blocks so numbered stratification can be 
accomplished by employing a systematic random sample. This is 
accomplished if we choose a random number between one and ten, in¬ 
clude the block with that number in the sample, and every tenth one 
thereafter. Thus, if the random number chosen were 2, the blocks with 
serial numbers 2, 12, 22, etc., to 4992 would be included in the sample. 
The estimating procedure will be the same as that indicated earlier; 
and the ^sampling error for this procedure usually will be somewhat 
smaller for the same size of sample. 

A second and perhaps more important use of stratification is to identi¬ 
fy by inquiry, in advance of drawing the sample, those blocks that 
have very large aggregate ^populations, say, blocks having more than 
approximately 50 dwelling units. It is particularly important to iden¬ 
tify large blocks with unusual characteristics such as those with large 
hotels, lodging houses, hospitals, jails, military establishments, etc. 
The large blocks can then be sampled separately from the other blocks 
of the city. The work of identifying these special type? of blocks can 
be facilitated by discussion with local groups such as city officials, the 
fire department, the police, postal employees, and other informed local 
groups. One can thus make use of an available resource in the form of 
the existing knowledge of various people in the community. 

It is not necessary to obtain an accurate identification of this special 
group of blocks in accordance with some rigid definition of ‘‘large*’ 
blocks. If we fail to include certain of these blocks in the special group, 
the sample of the remaining blocks will still reflect their contribution 
to the total, but the reliability of the sample result will be lower than if 
they were all correctly classified beforehand. 

Other criteria of stratification might be used in addition to the two 
that have been discussed. The investigator should recognize, how- 
ever, that extensive additional stratification beyond introducing some 
of the fairly obvious criteria is not likely to produce a substantial in¬ 
crease in precision in the estimates of general population characteristics 
such as the proportion employed, or distributions by age, sex, and other 
classes. Moreover, any of a number of different stratification proce¬ 
dures may be equally effective, so that it is usually not worthwhile to 
debate extensively the comparative merits of competing methods of 
stratification. 

A method for making more significant gains in the efficiency of the 
sample is to reduce the number of interviews per block and to increase 
the number of blocks in the sample. The possible increase in precision 
can be seen by considering as an illustration two ways of obtaining a 
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sample from a small section of a city that contains ten blocks and with 
an average of 25 families per blocks. First, consider a sample drawn 
from this area by preparing a list of all families in the area and choosing 
25 families at random from the list. Such a sample would be scattered 
o^er the entire area. It seems plausible that such a sample of 25 fami- 
lies will yield a more representative cross-section of the area than would 
a sample of 25 families obtained by drawing a single block at random 
and including all families within the selected block. The single block 
will yield a less reliable sample because neighboring families tend to re¬ 
semble one another more than will families throughout the area. It 
appears reasonable, and it can be shown that when this is true the fami¬ 
lies from a single block will not as adequately represent the various 
classes of families in the area under consideration as would a more widely 
scattered sample of the same size. 

The block sample approach was introduced because, as was suggested 
earlier, we do not have a list of families from which to draw a random 
sample, and because it may be much too expensive to prepare such a 
list. However, the reasoning just used suggests that we could obtain 
a better estimate for a given size sample by scattering the sample more 
widely. This could be accomplished by taking two half-blocks instead 
of one full block, or better yet by taking smaller segments of blocks, or 
by otherwise increasing the number of areas in the sample and decreasing 
the average size. Some statistical theory is available to guide one in 
determining the optimum size of segment to be used.^ The gains 
by this line of approach may be very substantial, but often with the 
resources available, it is not feasible to designate a sample consisting of 
segments of blocks. 

There are a number of ways other than subdividing the blocks which 
make it possible to have a larger number of blocks represented in the 
sample without increasing the number of families to be interviewed. 
One way is to select a larger sample of blocks but then to introduce a 
second stage of sampling within the selected blocks. This second stage 
of sampling is commonly referred to as subsampling. In a subsam¬ 
pling procedure one may list all the dwellings or other units to be sub¬ 
sampled in the sample of blocks, and select for interviewing a sample 
of the units listed. Then, if a sample of 10 percent of the persons is 
desired one might select every fifth block and then interview the per¬ 
sons living at every other address or dwelling within the selected blocks. 
One might then say that the effective size of the block is no longer the 
original block but the size of the sample drawn from the block. As was 
indicated earlier, a 10 percent sample drawn in this manner gives 


* See references 6, 7, 8, 15, and 18. 
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doilsiderably more reliable results tban would a 10 percent sample of 
blocks completely enumerated. 

When such a subsampling procedure is used one must keep the method 
of listing the units within the sample blocks as simple and economical 
as possible. In determining the kind of subsampling units to be listed 
One need only to remember that they should be readily identifiable, 
that they should be small, and that every person in the block must live 
in one of the listed units. For example, it is satisfactory to list dwell¬ 
ings and to interview all persons living at a sample of these dwellings 
provided that the dwellings listed are not too large (say, do not contain 
except in rare instances more than 40 persons). Apartments within 
structures containing (or appearing to contain), say, 5 or more apart¬ 
ments should be separately listed. Within institutions and large lodg¬ 
ing houses the unit of listing may be either a person or a room, which- 
ever is easier to identify and list. If rooms are listed the occupants of 
the rooms selected for the sample will be covered. 

The ‘‘best** or optimum determination of the proportion of blocks 
to be drawn into the sample from the various strata and the subsampling 
ratios to be used in the selected blocks is given by the available sampling 
theory.* The optimum ratios will depend on the relative costs of various 
operations, and on the amount of variability between blocks. If there is 
a relatively large variation between blocks in the characteristics being 
estimated, then, as one might expect intuitively, the theory points to the 
use of a larger proportion of blocks and a smaller subsampling ratio than 
would result if the variation between blocks is relatively small. This 
last statement has an important implication for sarnpling from the stra¬ 
tum of large blocks that has been discussed. These blocks not only are 
large in size but also the variation between them ordinarily will be rela¬ 
tively great. It follows that the proportion of those blocks included in 
the sample should be larger than the proportion included from the 
remaining blocks. 

While stathtical theory may be used to determine the optimum block 
sampling ratios and subsampling ratios, it is not necessary to adhere 
rigidly to such optimum values. One may depart moderately from the 
optimum values without significantly increasing the cost or the sampling 
error. Thus, the investigator has considerable latitude in selecting 
block sampling ratios and subsampling ratios so as to simplify the oper¬ 
ations and processing of the sample. One such simplification, for 
example, is to impose the condition that the results of the sample be 
self-weighting; that is, the estimate of the proportion of employed persons 
be simply the ratio of the number of employed persons in the sample to 


* See references 1 and 11. 
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the total number of persons in the sample. This is accomplished by 
making the product of the block sampling ratio and the subsampling 
ratio the same for the special group of large blocks as for the other blocks. 

The fact that it is not necessary to adhere rigidly to the optimum allo¬ 
cation in order to achieve most or a substantial part of the gains that 
may result from the application of the optimum theory means that some 
simple rules for drawing a block sample for a city can be given that have 
fairly wide applicability. Thus, an approximation to the optimum 
sampling ratios will often be accomplished by merely 

(a) using a uniform over-all sampling ratio in all strata; 

(b) determining the block sampling ratio and the subsampling ratio 
in the stratum of ‘'small-blocks*’ so that on the average about five families 
will be included per sample block; and 

(c) making the proportion of blocks to be drawn from the “large- 
block” stratum equal to 

y^average number of families per block in the 
I “large-block” stratum 


V average number of families per block in the 
“small-block*’ stratum 

multiplied by the proportion of blocks to be drawn from the “small- 
block” stratum. 

Assume, for example, that a sample of 5 percent of the households of 
the city is to be taken, and that the average number of families per 
block in the “small-block” stratum is approximately 25, and in the 
“large-block” stratum is approximately 100. To obtain an average of 
about five families per block from the “small-block” stratum the sub¬ 
sampling ratio would bo 5/25 = 20 percent. Since the percent of dwelling 
units to be included in the sample is to be the same in both strata and 
equal to 5 percent, the proportion of blocks to be drawn from the 

“small-block” group is —= 25 percent. The proportion of 

blocks to be drawn from the “large-block” stratum would then be 


/too 

25 percent, 

if we follow the rule just given; and the subsampling-ratio for the 
‘‘large-block” stratum would be 

= 10 percent. 
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The introduction of subsampling may make it possible to attain the 
accuracy with perhaps a 3 percent sample of families that would result 
from a 10 percent sample if the blocks were to bo completely enumerated. 
Such a decrease in sample size for equivalent reliability is not unusual 
when one uses a reasonably close approximation to the optimum design. 

It should be emphasized that the preceding discussion of methods 
of sampling from a city has been concerned with the problem of estimating 
proportions, percentage distributions, or other average characteristics 
from the sample and not with the problem of estimating the total number 
of persons in the population, or the total number of employed persons, 
or other similar aggregates. The principal difficulty in estimating 
totals from block samples as described above arises from the sensitivity 
of such estimates to wide variations in the number of families per block. 
Estimated ratios are not affected so severely by the variation in size of 
block, because both the numerator and the denominator of the ratio 
often tend to vary together so that their respective sampling errors are 
likely to offset one another partially in the computation of the ratio. 

If blocks were relatively uniform in size the procedures described 
above would yield good estimates of totals. But because blocks ordi¬ 
narily vary widely in size, some further resources must be found and 
used to reduce the effect of variation in size of block, or a further price 
must be paid in the form of modifying the sampling procedure or of 
substantially increasing the size of sample if estimates of totals are 
likely to be made with a reasonable degree of reliability. 

The additional resources that may prove particularly heljjful are counts 
of the approximate number of dwellings in each block in the city. These 
may be available from a relatively recent census, or may be obtainable 
from aerial photographs or from other maps or records. If such approx¬ 
imate measures of size cannot be obtained from available records, it 
may be worthwhile to obtain them by means of a field survey procedure 
in which each block in the area is visited and quick count of the approxi¬ 
mate number of dwellings in the block recorded. Such an operation 
can be carried out with satisfactoiy accuracy at a fraction of the cost 
that would be involved in preparing an accurate listing of the addresses 
of all the dwellings m an area. Once measures of size are obtained for 
the blocks, the blocks may be stratified by size. Sampling the blocks in 
each stratum and then subsampling dwellings, a-s described earlier, will 
result in a sample that will yield much more reliable totals, for a given 
size of sample, than would result from the sample design suggested earlier 
in which only the v<iry large blocks were identified in the stratification. 

This procedure was followed a few years ago in the Bureau of the 
Census to obtain highly reliable estimates of population totals for a series 
of metropolitan areas that had been subject to tremendous growth 
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during the war and for which the prior census figures had become so 
out-of-date as to be of little use for current planning. These surveys, 
using fairly large samples, gave estimates of the total population that 
could confidently be expected to be in error by less than 2 percent for 
each of the metropolitan areas.» 

There are methods other than stratifying by size of block for reducing 
the effect of variability in size of block on estimated totals, that are 
discussed else where. ^ 

Another type of resource may sometimes be available that can be 
used to achieve the desired results at lower cost. Sometimes a relatively 
recent city directory or other moderately complete listing of the dwell¬ 
ings in an area is available. Such listings may be used effectively and 
without biasing the sample results, even though they are not com¬ 
plete, provided they do not contain duplicate listings for the same 
address. This type of resource can be used by proceeding in the follow¬ 
ing way: 

The dwellings in the city can be regarded as divided into two major 
strata for sampling purposes: (a) The dwellings that are listed in the 
directory; and (b) The dwellings that are not listed in the directory. 
The sample from the stratum consisting of those listed in the directory 
can be sampled in accordance with the ideal procedure mentioned earlier 
of sampling from a list. In some instances they may be sampled in small 
clusters from the list if evaluation of cost considerations, together with 
the increased sampling variance resulting, point to such an approach. 
In such a sample some addresses drawn may no longer represent dwell¬ 
ings. This is the case if a building has been converted to non-residential 
use, or torn down or destroyed, or has otherwise disappeared. Such 
addresses should be omitted from the sample. No substitution should 
be made for these since the sample of addresses should reflect such 
disappearances. 

The sample of the remaining dwellings in the city—those that do not 
appear in the directory—should be drawn by a block sampling proce- 
dure similar to the one outlined above. The procedure for this stratum 
of dwellings not in the directory will be to check the directory for each 
sample block and pick up from this sample block only those dwellings 
that do not appear in the directory. If there are in the city some blocks 
that have an especially large amount of new housing, it may bo desirable 
to define these blocks as constituting another special stratum. 

It should bo pointed out that a design that is adequate for estimating 
population aggregates is also an effective design for estimating propor- 

« See reference 1. 

* See for example, references 6, 8, 11, and 24, 
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tions. Thus, the introduction of controls on size of block will have the 
effect of increasing somewhat the accuracy of estimates of proportions, 
although the importance of such controls here is not as great as it is in 
estimating totals. For estimating totals careful control on the size, of 
blocks may enable us to make such estimates with an accuracy equal 
to that obtainable from a sample that is several times as large but 'used 
without such control on the size of blocks. 

It should be remarked finally, with respect to the problem of sampling 
from a city that although designs can be used for which the actual 
sampling operations can be carried out in a simple and straightforward 
manner, the determination of the necessary size of sample, and the re¬ 
liability of results from a sample are technical problems calling for care¬ 
ful study and application of available sampling theory, much of which 
has not yet appeared in published form. If efficient and reliable samples 
are to be obtained, this work must be put in the hands of persons trained 
in sampling theory and practice. 

This discussion has centered on the problem of making estimates 
for local areas such as cities or counties. When estimates are desired 
for the country as a whole, or for other broad areas, many other con¬ 
siderations must be taken into account. Factors which are relatively 
unimportant in sample design for local areas may now become extremely 
important, and conversely. For example, in nation-wide surveys the 
convenient, or the optimum primary sampling unit to be used may often 
contain as many as 100,000 or more persons, while in local area surveys 
primary units with as few as 200 persons may be considered large. 
Stratification plays a much more significant role in designs for national 
than for local surveys, although even for national surveys its impor¬ 
tance has often been exaggerated. Travel costs, mapping costs, the 
use of past information, all have a more prominent part in the design of 
national samples. The type of sampling used in such surveys is affected 
by the organization of the field operations, particularly whether the 
administration of the work is centralized or decentralized. It is im- 
possible within the limitations of the space of this paper to elaborate 
on these principles but they are discussed in the available literature.® 

Similarly, the sampling of farms, business establishments, or certain 
types of data for individuals or families such as average or aggregate 
income, where a few individuals or units contribute a considerable part 
of the total, call for other special sampling procedures that have not been 
treated in this paper. While the fundamental sampling theory to be 
applied is the same in designing samples for these purposes, the points 
for special emphasis are sometimes quite different. In these problems, 

» See especially references 6, 8, 11, 18, and 19. 
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for example, stratification, and the use of special lists, assume an es¬ 
pecially important and significant role. Mail survey methods are 
especially important in sampling business establishments, and can be 
supplemented by other methods in order to yield results of known pre- 
cision. Some further discussion of these problems and methods is 
available elsewhere.® 
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R^sumi 

Cet expos4 n’a pas pour but de presenter de nouveaux r6sultats mais 
plutdt de passer en revue quelques-unes des m^thodes de Bondage don- 
nant des estimations dont on puisse calculer I’exactitude. Seuls seront 
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pris en consideration ici les plans d’^chantillonnage remplissant les con¬ 
ditions suivantes: 

1) II doit etre pratiquement certain que la difference entre Testi- 
mation et le paramfetre k estimer ne d^passe pas uiie certaine quahtite 
fix6e d’avance. 

2) La procedure envisagee doit etre simple et directe. 

3) Parmi les differents plans remplissant ces deux conditions, les 
plan choisi devra donner la plus grande exactitude pour un cotit 
donne. 

Si les deux premiferes conditions sont remplies, on peut evaluer objec- 
tivement Texactitude des resultats du sondage, sans dependre de sup¬ 
positions ou de jugements sur la plus ou moins bonne representation que 
rechantillon donne de la population. Les plans d’echantillonnage qui 
remplissent les conditions precedentes doivent utiliser effectivement 
toutes les sources d’information disponibles, mais la selection finale de 
rechantillon doit etre laissee au hasard. Pour de tel les methodcs de 
sondage il est possible de calculer I’erreur d’echantillonnage, ce qui per- 
met de determiner le nombre d’eiements que rechantillon doit comporter 
afin qu’on obtienne une certaine precision donnee 4 I’avance. De plus, 
si le cofit unitaire des differentes operations de I’enquote est eonnu, il 
devient possible de choisir la methode qui donne la plus grande precision 
pour un cofit donne. 

Malgre I’apparente complcxite de la theorie des Bondages, le choix 
d’echantillons au hasard de differents types, peut en pratique etre rela- 
tivement simple. Une methode, par exemple, pour obtenir un echan- 
tillon au hasard des habitants d’une ville, est de choisir au hasard des 
“blocs” et do former rechantillon avec tous les habitants des blocs choi- 
sis. Un tel precede peut, cependant, ne pas etre trfes efficace. 

Un echantillon forme de blocs peut, en general, etre ameliore en fai- 
sant k I’avance une liste de certains blocs ayant une population trfes 
elevee et en faisant un sondage particulier de ces blocs. Plusieurs autres 
precedes de stratification peuvent aussi etre utilises. Des gains 
significatifs dans I’efficacite de rechantillon peuVent etre obtenus en 
repartissant rechantillon plus largement a travers la ville par une aug¬ 
mentation du nombre de blocs dans rechantillon et par une diminution 
du nombre d’‘‘interviews” dans chaquo bloc. La theorie des sondages 
permet de determiner le nombre optimum de blocs k comprendre dans 
rechantillon et la proportion de la population de chaque bloc k compren¬ 
dre dans rechantillon. 

Si rechantillon compose de blocs doit donner de bonnes estimations 
de chiffres totaux plutdt que de proportions ou de moyennes, il est im¬ 
portant de controler les variations du nombre de menages par bloc. Ceci 
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pi^ »e faire par un compte approximatif du nombre de logements 
dans chaque bloc de la ville et en classifiant ensuite les blocs suivant 
nombre. 

L’importance relative des difFerents aspects d’un plan d’echantillon- 
nage depend en grande partie du problfeme particulier consider^. Par 
exemple, des facteurs sp^ciaux doivent 6tre pris en consideration quand 
le problime consiste choisir un echantillon de fermes, d’etablissements 
commerciaux, ou de m^ages, en vue d’estimer des caract^ristiques 
comme le revenu moyen ou le revenu total, cas dans lesquels il est pos¬ 
sible que quelques unites constituent une trfes large part du total. 



commercial uses of sampling 


by J. Stevens Stock and Joseph H. Hochstim 

Opinion Research Corporation 
(United States) 

I 

The purpose of this paper is to report A some of the commercial uses 
of sampling. We shall describe a series m actual examples which show 
how a commercial research agency meets its sampling problems. As 
in all sampling problems, the nature of the research objective and the 
facilities at hand are the all-important conditions which determine the 
approach. 

1. Most commercial agencies must be prepared to tackle an extre¬ 
mely wide variety of sampling problems. No one sampling procedure 
or principle is applicable in all, or even in a majority, of cases. 

2. The actual budget is frequently not commensurate with the actual 
difficulty of the problem. Often it is necessary to do the best job pos¬ 
sible under a very restrictive budget, even though a larger budget would 
allow for much greater dollar efficiency. 

3. Most commercial research problems are geared into current-policy 
determination. Consequently, research efficiency must sometimes be 
sacrificed for speed. 

4. Although there are important exceptions, commercial research 
problems are for the most part nonrecurrent. Tims series and repeti¬ 
tive studies are conducted, but are relatively small in number. 

6. Many research problems must be tackled with limited source ma¬ 
terial because of the specialized nature of the problems. 

6. Many commercial research studies must cover unusual, difficult- 
to-define universes of people, such as the purchasers of a given commo¬ 
dity, all chemists in the United States, all people who will vote in the 
next election, etc. 

7. Commercial research agencies often find it necessary to study 
attitudes and opinions which have highly emotional, personal, or moral 
implications in the respondent’s mind. 

8. Very often, even in large national studies, the commercial re¬ 
search agency must make detailed analyses for relatively small areas 
within the country. This makes it necessary to maintain extremely 
largo part-time staffs widely distributed throughout the nation. 


120 
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Regardless of any pet theories, the sampler has to consider the fol¬ 
lowing: 

1. The problems the user of the data needs to have answered. 

2. The actions likely to be based on the results of the survey. 

3. The degree of precision required. 

4. The size of the budget. 

In any case, the sample design chosen should provide the user of the 
(lata with maximum information at minimum cost. 

f 

II 

Our first example involves the sampling of purchasers of alcoholic 
beverages. It is illustrative of the quick, nonrecurrent survey of a dif¬ 
ficult-to-define universe on a subject that for some respondents has 
moral, personal, and political implications. In one particular state a 
law had been passed increasing the liquor tax. The client, a distilling 
company, wanted to know who is getting the blame from purchasers of 
hard liquor for the increase in prices—the state government, the dis¬ 
tillers, or the distributors. The answer to this question would deter¬ 
mine the direction the client’s public relations effort will take and the 
issues on which it will concentrate. 

Early testing of the questionnaire indicated that people were unable 
or unwilling to give accurate answers as to their purchases of alcoholic 
beverages, except at the time of purchase. The client, however, was 
interested in directing his public relations effort at the purchasers of his 
product so that it would have the greatest impact. It was necessary, 
therefore, to design the sample so that the number of respondents was 
approximately proportionate to the amount of sales in the sample areas. 

In the state being surveyed packaged alcoholic beverages are sold 
only in state liquor stores. Data on liquor sales were available for the 
past year for different districts of the state, for individual towns in each 
county, and for individual stores. The sample was designed as follows: 

The number of interviews with purchasers in the various districts was 
computed in proportion to the amount of liquor sales in each district. 
The two largest cities of the state were removed from their districts and 
treated as separate units. Interviews were allocated to these two cities 
separately according to the amount of their own liquor sales. 

Each district was divided into three groups of counties: those with 
high per capita consumption, those with medium, and those with low 
per capita consumption. 

Within each of these three groups of counties the towns were strati¬ 
fied by per capita volume of liquor sales. One sample town was selected 
from each stratum. The number of interviews with liquor purchasers 
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allocated to each sample town was in proportion to the total volume 
of liquor sales of the county group from which the town was selected. 
Within each town a list of stores was prepared and arranged in rank 
order according to volume of liquor sales. Stores wore then selected 
within each sample town systematically with probability of selection 
proportionate to sales volume. 

Interviewers were instructed to stand outside the stores selected and 
to interview every nth person leaving the stores until the allocated num¬ 
ber of interviews was complete. In order to assure proper distribution 
by time of day and day of the week, interviewers were instructed to in¬ 
terview half of their respondents on Friday afternoon and Saturday, 
and the other half on other days of the week. In addition, the inter¬ 
viewers were instructed to fill half their quotas before 4:00 p.m. each 
day and half of them after 4:00 p.m. each day. 


m 


Our next example is typical of a study of the community relations 
of an industrial firm. 

The largest employer in a Midwestern town of about 100,000 popu- 
lation felt that hia company had done a good job of public and indua- 
trial relationa. But in spite of all its efforts the company had a strike. 
The executives wanted to know very quickly what could be done to cor¬ 
rect an apparent hostility of the citizenry of the community. The 
problem of the survey was to find what the people in the community 
were thinking about the company and its employees and what the com¬ 
pany could do in the opinion of the community to make their plant a 


better place to work. , j. 

The 1940 Census Block Statistics, which were available for this city, 

were brought up to date in numbers of dwelling units with the aid of 
the city planner’s data on new construction. All blocks were then 
stratified first by census tract, then by average rent. Within each of 
these strata they were arranged by the number of dwelling units per 
block The sample blocks were selected by systematic random samp¬ 
ling with probability of inclusion proportionate to the number of dwell¬ 
ing units in each block. • . j 

Within each block the interviewer was given a starting point and 
instructed to go in clockwise direction and to interview every nth dwell¬ 
ing unit in the assigned block until the quota for that block was filled. 

In cases of non-iiiterview because of refusal or because no one was at 
home, interviewers were told to go to the next dwelling unit, but to 
continue the count from the dwelling unit originally designated. In 
■order to minimize the bias resulting from the omission of not-at-homes 
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and to give more adequate opportunity for getting employed workers 
in the sample, interviewers were required to do their interviewing in 
the evening and over weekends. 

Quotas covering the whole city by sex and age were given to the 
supervisor. By cumulative daily tallies of the interviews returned, 
the supervisor was able to watch the representativeness of the survey. 
He assigned varying quotas to the interviewers for the selection of in¬ 
dividuals within the sample households when certain age-sex groups 
in th^ population appeared to be under-represented according to the 
over-all quota.^ 


IV 


The next example is a survey to measure the attitudes of social science 
teachers toward basic principles of free enterprise economics. The 
particularly difficult problem in this case was to get a cross section of a 
highly specialized population, namely college and high school teachers 
of government, economics, sociology, and history. 

The sample of high school teachers was allotted by states according 
to data on high school enrollment published by the Office of Education. 
Interviews wore allocated to cities and towns in proportion to the popu¬ 
lation distribution of urban places within each state. The selection 
of the 160 cities and towns within states and size-of-town groups was 
determined by the location of the company's resident interviewers.* 

Heoent experience with this combination of areal and quota techniques indi¬ 
cates that much of the interviewer’s tendency toward bias is eliminated by the syste¬ 
matic pre-sclection of each dwelling unit in which an interview is to take place. ‘ The 
use of quotas for the selection of an individual within each household allows the inter¬ 
viewer very little free choice. 


At first glance, it would seem that the selection of towns to suit the convenience 
of the resident interviewers is quite unrigorous. In this case, however, it is an. 
excellent means of selecting a random sample of towns. Since there is no conceivable 
correlation between the methods by which part-time resident interviewers are recruit¬ 
ed and any attitude characteristic of the social science teachers being studied, we can 
say that we have selected our sample at random. 

It IS a common practice in commercial research firms (and others as well, we pre- 
same) to base the selection of localities for the cross section on the location of the 
iwi ent staff. Many suspect this technique of bias. However, as long as the 
investi^tor can guarantee that the method of recruiting is in no predictable way 
coi^ted with the problems studied, we can be assured that the selection of loca- 
IS as much at random as if it had been based on the use of random number 
or some game of chance. 

maintain large part-time resident inter- 
st^s rwrait them m proportion to the distribution of the population by 

niimha^ f within states. In this case the total maximum 

*hftn mteryiewers availal?!? was approxin»ately 1.000 located in more 
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As for college teachers, a complete list of all colleges was prepared by 
type—senior, junior, and teacher colleges—and was arranged by states. 
The number of teachers was recorded for each college, and the colleges 
were put into two groups: those with a teaching staff of 200 or more 
and those with less than 200 teachers. Every wth college was selected 
for the sample. 

Since in neither case was there available a total count on any social 
or economic characteristic of teachers of social science subjects, it was 
impossible to assign any quotas by characteristics. It was necessary, 
therefore, to insure a strict randomization of the respondents. Accord¬ 
ingly, interviewers were instructed to obtain a complete list of social 
science teachers for the sample colleges and all high schools in the towns 
selected. The interviewers were further asked to alphabetize this list 
and to interview the first n teachers starting with a given letter of the 
alphabet. Interviewers were given different starting letters. 

A separate part of this survey illustrates the use of mail questionnaires 
in studying a highly specialized universe. A large industrial company 
had conducted for social science teachers a course of several weeks in 
some of the social problems faced by business and the techniques used 
in solving these problems. The purpose of this study was to measure 
the impact on teachers of impressions obtained in this course. 

A complete list of all participants in the course was obtained. Post 
cards were mailed to participants asking them to state by return mail 
whether they would be willing to answer a mail questionnaire. 

A groat majority of the teachers expressed their willingness to answer 
the mail questionnaires. When the returns were counted, however, 
slightly less than 50% of all participants actually mailed question¬ 
naires. 

Since it was felt that the returned sample might not be rei)resenta- 
tive and that those teachers who had not returned the mail question¬ 
naires might be different in their characteristics and attitudes, it 
was decided to take a separate sample of non-returners by personal 
interviews. 

The industrial company that gave the course was located in a very 
large Midwestern city, and about 40% of the teachers attending the 
course lived within an area of 15 miles from the plant city. It was de¬ 
cided that resident interviewers were to telephone all social science 
teachers included in the original list who lived within a 15-mile radius 
of the plant city. They were to inquire whether the teachers had re¬ 
turned the mail questionnaires and if not, to make an appointment for 
a personal interview. 

By this method, interviews with approximately one fourth of the 
teachers who did not answer the mail questionnaires were secured. It 
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was then assumed that those who did not answer the questionnaires and 
who lived in the plant city area were representative of all the teachers 
not answering the questionnaire. Accordingly, the answers obtained 
by personal interviews were weighted to give proportionate representa¬ 
tion to those who had, and those who had not, answered the mail ques¬ 
tionnaires. 


V 

Much commercial research is devoted to studying the style or product 
preferences of highly specialized groups in the population who are actual 
or potential customers for a certain commodity. The purpose of such 
research is to get rough estimates of relative customer preference in 
order to guide manufacturing and sales policy. 

A survey of this kind was recently conducted to determine style pre¬ 
ferences for a particular piece of furniture. In order to set up as nearly 
as possible a realistic buying situation, the study was restricted to three 
separate groups: 

1. Well-to-do respondents were questioned on styles in high-priced 
items. 

2. Average and medium-well-to-do respondents were questioned 
on medium-priced items. 

3. Poor respondents were questioned on styles in low-priced items. 

All types of respondents were questioned on a few furniture styles. 

To simplify the approach and meet the restrictive budget, interviews 
were conducted only in towns with population of 50,000 or more. All 
towns having 50,000 or more population were stratified by geographic 
sections. Interviews were allocated to cities and towns in proportion 
to their population in groups of 15 or multiples of 15. In the case of 
small cities, this amounted to arraying them by population size and 
selecting an ordered random sample of cities. However, instead of 
selecting every nth city, we selected every nth person, so that the pro¬ 
bability of selecting any one city was determined by the chance of select¬ 
ing any one person living in the city. Therefore, the probability of 
selecting each city was proportionate to its population size.® 

Within each of the cities selected a relatively large primary sample 
of 100 to 300 blocks was chosen by selecting every nth block from the 

» A common practice of commercial research agencies is to assign interviews 
in groups of, say, 10 or 15, in order to give each interviewer an assignment large 
enough to make it worth his while to start on the study and small enough so that he 
can finish his interviewing in the time limits set for the study. 
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published block statistics. From these large samples of blocks, smaller 
samples of blocks were selected for assignment * 

Within each city the primary sample of blocks was divided into three 
broad groups: high-rent, medium-rent, and low-rent blocks. In the 
large cities in the sample, where as many as three groups of 15 interviews 
were assigned, three interviewers were assigned to sample blocks cor- 
responding to each of the three rental groups. In smaller cities, where 
only one or two sets of 15 interviews were assigned, interviewers were 
required to interview in sample blocks from (correspondingly) only 
one or two of the rental types. Thus, no attempt was made in smaller 
cities to get a cross section of each city since no individual city analyses 
were required.® 

Blocks within each of the three broad rental groups in each sample 
city were selected by stratifying the primary sample of blocks for each 
broad rental group into three strata according to rent. From each of 
these three rental substrata, three blocks were selected at random with 
probability of selection in proportion to the number of dwelling units 
on each block. Thus, each interviewer was assigned one type of ques¬ 
tionnaire in one broad rental group. Further, he was assigned three 
blocks from each of the three rental substrata (9 blocks in all). The 
interviewer was instructed to take five interviews from each set of the 
three blocks in each rental substratum. He was also instructed to go 
around as many of the throe blocks as necessary to contact respondents 
owning the particular piece of furniture or saying they were in the market 
for one. If the respondent did not meet this qualification, the inter¬ 
view was discontinued and contact was made with the next dwelling 
unit. Wherever the respondent owned such a piece of furniture or was 
in the market for one, the interview was completed. 

Various styles of furniture of different price range were judged by res¬ 
pondents (higher-priced pieces by respondents living in the higher-rent 
blocks, lower-priced pieces by respondents in the lower-rent blocks). On 


^ This practice of selecting relatively large primary samples of blocks, then stra¬ 
tifying them by section of the city, rent, and number of dwelling units, for further 
selection of smaller samples of blocks amounts to double namplirg. It appears to 
be a very useful practice where small samples of blocks from relatively large cities 
are needed. The very practical reason for this kind of double sampling is to save on 
the burdensome clerical time that would be required to stratify all the thousands 
and tens of thousands of blocks in a large city. It is necessary only to stratify the 
primary sample of 100 to. 300 blocks. 

" The reason for this assignment procedure was that a different questionnaire 
was used for each type of respondent—the well-to-do, the average, and the poor. 
Because of the complicated nature of the interview and the danger of confusing the 
questionnaires, only one type of questionnaire wa^ assigned to each interviewer. 
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a few pieces of medium price, however, we measured preferences for all 
three groups for purposes of experimental control. 

VI 

A frequent problem for any research agency is the high expense of 
travel from interview to interview. The next example illustrates a prob¬ 
lem in studying farmers’ opinions, one of the worst situations from the 
standpoint of interviewer travel cost. 

During wartime, government regulations determined prices and con¬ 
ditions under which much farm produce could be sold by farmers to food 
manufacturers and processers. There was considerable resentment 
on the part of the farmers against these regulations. There was also 
resentment against the manufacturers who in the opinion of some farmers 
manipulated these regulations to their own advantage and to the far¬ 
mer’s disadvantage. 

The purpose of the survey was to study farmers’ sentiments on this 
issue. It was decided to restrict the study to seven counties in a Mid¬ 
western state—an area where the client did most of his purchasing. 

Interviews were allotted to each county in proportion to number of 
farms, but in order to save cost, interviewing was limited to every other 
township. 

State highway maps were obtained on which square-mile sections 
within each sample township were numbered. 

The number of sections within each sample township was recorded, 
and a cumulative total of these sections was obtained. Then the average 
number of farms per section was computed. In each county the desired 
number of sections was obtained by dividing the assigned number of 
interviews by the average number of farms per section. In order to con- 
centrate interviewing still more, two adjacent sections were combined 
into one double section. The sampling ratio was then obtained by di¬ 
viding the total number of sections in the sample of townships by the 
number of double sections wanted. An ordered sample of every nth 
double section was selected. Interviewers were instructed to interview 
every farmer in the double sections selected, making call-backs wher¬ 
ever the farmer was not found at home.® 

vn 

Frequently firms desire to make opinion studies among their customers, 
or associations want to 'poll a cross section of their members. Often 

• This concentration of interviews in double sections is. of course, less efficient 
in a statistical sense than a sample of single sections or individual farms. In the 
information-per-dollar sense, however, it is undoubtedly much more More- 

ovar, it greatly facilitates call-baokt. 
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in such cases the client firm or association can supply a complete list of 
the universe to be studied. The sampling problem is then usually very 
easy; we stratify the names on the list as efficiently as possible and select 
every nth name. 

Shortly before the end of the war, the planning board of a metropolitan 
area was concerned with the potential postwar employment in the area. 
During wartime the population of the area had increased very con¬ 
siderably, and it was important to make an estimate of the number of 
people for whom employment might be provided in the years to come. 
The budget for the survey allowed interviews with 1,600 employers 
in the area. A complete set of cards showing each firm, its industry 
group, and the numbers of its employees was made available by the 
client. In the area to be studied there were approximately 750 firms 
having 50 employees or more, which accounted for about 54% of all 
employees in the region. It was decided to include all these 750 firms 
in the sample. 

Of the remaining 15,000 firms having less than 50 employees every 
20th one was selected. 

Thus, approximately equal numbers of firms having more and less 
than 50 employees were selected for the sample. By full coverage of 
firms that were more important in terms of employment, the statistical 
error in projecting the average number of employees was reduced con¬ 
siderably.'^ 

The cards for employees of 50 persons or less were stratified by de¬ 
tailed industry groups, and were arranged within each group in ascending 
order from the smallest to the largest firms. Every 20th card of each 
industry group was then selected, carrying over the count from one in¬ 
dustry group to the next. 


VIII 

The next survey, which uses quota sampling, illustrates a very impor¬ 
tant and useful technique for studying many different and wide spread 
populations at the same time. 

In this instance the purpose of the survey was t > bring out pertinent 
facts bearing upon the public relations program of .. p .iticular industry. 
A variety of issues was to be covered, and each issue was to be explored 
thoroughly. 

’ This example illustrates the common case in which certain segments of the popu¬ 
lation to be studied contribute such high variability to the final statistical estimate 
that it is efiBcient to sample disproportionately from different strata. This amoimts 
to a very simple application of what is commonly called ''Neyman scunpling.*’ 

18 
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The research problem was to describe in detail the attitudes of many 
different “publics’’ toward this industry:® 

1. Manual workers employed in this particular industry. 

2. Residents of each of the major areas (each was analyzed separately) 
in which the industry is concentrated. 

3. Separate cross sections of the general population in seven geo¬ 
graphical regions. 

4. A national cross section of the continental United States. 

The national cross section was made up of interviews allotted to appro¬ 
ximately 450 localities in proportion to the population of geographic 
regions, states, and of size of town groups. Each interviewer was assign¬ 
ed quotas by sex, age, race, employment status, and occupation. These 
quotas were based on 1940 Census data adjusted wherever possible, to 
more recent Government estimates. 

In four of the seven geographic regions, the national cross section 
sample was adequate. In the other three, additional interviews were 
taken to supplement those obtained in the national cross section. These 
extra interviews were assigned to the sample localities in proportion to 
the distribution of the general public in these regions. 

Major industrial areas were defined as all counties in which a minimum 
of 3% of all employed men were engaged in this particular industry. 
Those counties were stratified according to population and according 
to precent of men employed in the industry. These substrata were set 
up so that the aggregate populations of the counties in each were appro¬ 
ximately equal. ‘ A sample of counties was then drawn at random from 
each stratum. Generalrpublic interviews in the national or regional 
sample which were taken in counties where more than 3% of the employed 
men were employed in this industry were included in the sample of major 
industrial areas. Consequently, the number of interviews allocated to 
counties in each stratum was reduced by the number of interviews 
already taken in this stratum in other samples. Since there was con- 
siderable overlap between the different areas analyzed, very substantial 
savings were effected by taking advantage of the duplications. Quotas 
were assigned by sex, age, race, employment status, and occupation 
in proportion to the distribution of such characteristics in each major 
industrial area. 

* More and more in public relations resecirch it has b^en found useful to study the 
“concentric circles” of populations toward which the public relations effort is being 
directed. This puts great premium on developing efficient sampling techniques for 
overlapping populations. In such cases ingenious and workable methods are needed 
to take fullest advantage of the additional efficiency gained through making each 
successive sample contribute to the sample of the next concentric population. 
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Interviews with industry employees were taken in the sample counties 
in the major industrial areas in proportion to the employment in the 
industry in those areas. The remainder of the industry employee sample 
was allocated among the national sample localities in proportion to the 
employment in the industry in those localities.® 


A very interesting and ingenious application of an older technique, 
which has been largely abandoned in the past ten years, has recently 
been reported by Benson, Young, and S y z e.*® 

This technique, now known as pinpoint sampling, was used by the 
American Institute of Public Opinion in connection with the 1944 pre¬ 
sidential election. 

Past election results for five particular states were found to repre¬ 
sent a remarkable reflection of national election outcomes for all two- 
party contests since 1916. 

Within each one of these five states, eight precincts were selected for 
the sample. The precincts within each state were chosen in such a way 
that, “giving equal weight to each, the average of the percentages of 
the vote of either major party was virtually the same as the election 
result for the state.” This was found to have been true in three pre¬ 
vious statewide elections. 

Within the precincts selected interviewers were instructed to inter¬ 
view in every—or every other—dwelling unit, depending on the number 
of voters in the precincts. The interviewers still retained the freedom 
of selecting respondents within the family group, except for the limi¬ 
tation of obtaining over-all quotas for sex and age. 

Interviews were completed in about one half of the households in 
the sample election districts. Slightly more than one fourth of the 
potential voters were interviewed. 

" Note: Quota samplixig .has been widely condemned in recent years. Prin- 
cipaUy, its validity can be questioned on the underlying inverse logic on which it is 
b ased—^namely: 

1. A representative cross section will reflect known characteristics accurately; 

2. Therefore, a sample which reflects known characteristics accurately is a repre¬ 
sentative cross section. 

In spite of this dubious logic, it can be shown that imder certain not uncommon 
conditions quota sampling may have the highest cost efficiency of any method now 
known. 

Edward G. Benson, Cyrus C. Young, and Clyde A. Syze, “Polling Lessons froln 
the 1944 Election,” The Public Opinion Quarterly, Winter 1945-46. The authors are 
indebted to Messrs. Benson, Young, and Syze for their permission to present t]i68e 
findings. 
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The results show a deviation of 1*9% from the actual national vote. 
Part of this deviation was due to the selection of states and part to the 
selection of precin ts. Benson, Young, and Syze concluded from the 
results that impr* j, j aents could most profitably be made by enlarging 
the number of n^}io areas and taking a smaller number of interviews 
within each area. 

We have here a case of sampling by purposive selection,^^ 


X 

Although the problems already presented show the great variety of 
situations a commercial research agency has to meet, there are many more 
entirely different sampling and interviewing situations that cannot be 
covered in detail here. 

Some of the sampling techniques described might vary according 
to the particular survey situation. In a survey taken in a town and 
in its surrounding rural area, for neither of which were block statistics 
available, the sample was designed by drawing routes on a town map 
and state highway maps. The routes were drawn in such a way as to 
include different sections in the town as well as the different types of 
roads in the survey area. Interviewers were to interview in every n\\i 
house on the right side of fhe route designated until their quotas were 
completed. Different starting points were chosen for the routes, some 
leading from the town towards outlying areas, others starting as far as 
15 miles from the town and leading toward it. 

Another example of a special situation: Even though interviews 
are generally done personally with only one respondent in any one house¬ 
hold, there are cases where it is best to interview husband and wife 
together in order to duplicate a family buying situation, (for example, 
when a survey is made on intended purchases of refrigerators). 

” The use of the method of purposive selection has been roundly condenuied 
by many writers on the subject of sampling. Gini and Galvani in an article in 
Annali Di Statistica in 1929 showed empirically that this method was very inefficient. 
Later, Neyman in his now famous article, “On the Two Different Aspects of the 
Representative Method,” The Journal of the Royal Stutistkal> Sockty, 1934, con¬ 
firmed theoretically Gini’s and Galvani’s findings. 

Neyman, however, did express the opinion that under certain very rigid condi¬ 
tions purposive seletition might be an efficient method of sampling. One of those 
very rigid conditions was that the technique might “work” when the controls were 
Very highly and linearly correlated with the statistics to be measured. Although 
Benson, Young, and Syze do not discuss this point, it seems reasonable that the 
method of pinpoint sampling may have very important possibilities in predicting 
Section respite, 
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Even though most questioning is done by personal interview, there 
are situations where telephone interviews are satisfactory (for example, 
a survey with a short and strictly factual questionnaire and a special¬ 
ized universe all members of which are telephone subscribers). 

In other cases, such as in '"in-plant studies,” self-administered group 
interviews are used with a sample including every nth employee. 

In situations where respondents might feel that their statements could 
place them in some form of jeopardy, it may be necessary to interview 
on the street to allay any possible suspicion that respondents might be 
traced. 

In cases of a management sample, such as sales managers or public- 
relations directors of companies with assets of more than $5,000,000, 
it may be necessary to sample from such* sources as Moody'^ and Standard 
and Poor, and from individual state directories, supplemented by what¬ 
ever information is available through local chambers of commerce. 

In a survey with stockholders, where the composition of the univers(» 
was unknown, information was 'obtained on the characteristics of the 
types of people who are most often owners of stocks by including a 
(juestion on stock ownership in other large national surveys. The survey 
with stockholders could then be restricted to these types, with the rea¬ 
lization, of course, that the unusual types of stockholders would not be 
included. 

There are numerous other situations—radio surveys, magazine sur¬ 
veys, advertising studies and many others—which require various ap¬ 
proaches suited to their special needs. 

Looking back at the examples given, we realize that there are many 
other possible sampling approaches to these problems. The purpos(‘ 
of this paper is to report, not to analyze. These were the approaches 
that were actually used. They are presented hero to illustrate a few 
of the many commercial uses of samyding. 


Resume 

Comme dans tons les problemes d’^chantillonnage, la nature du but do 
la recherche et les facilit^s dont on dispose sont les plus iraportantes 
conditions qui determinent la methodc a suivre. 

1. Nombre de bureaux commerciaux doivent etre prepares a entre- 
prendre Tetude d’uiye extremexnent grande variete dc problfemes 
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d’4ohantillonnage. Une seule et mSme procedure ou un seul et meme 
prinoipe ne peuvent 6tre appliqu6s It tous les cas, ni meme dans la 
majority des cas. 

2. La difficulte des probl^mes pos^s et les budgets disponibles ne 
varient pas proportionnellement. 

3. La plupart des problfemes sont pos^s en vue de decisions imme- 
diates de gestion des affaires. En consequence, la quality de la recher¬ 
che doit parfois etre sacrifice It la rapidite d’information. 

4. Bien qu’il y ait d’importantes exceptions, les problfemes de re¬ 
cherche commerciale, pour la plus grande par tie, ne sont pas periodiques. 
Des series ordonn^es dans le temps et des etudes r^petees sont relative- 
ment peu nombreuses. 

5. A part les conditions limitatives de budget et de rapidite d’infer-' 
mation, nombre d’enquetfs doivent se fonder sur un materiel de base 
limits en raison de la nature sp^cialisee des problemes. 

6. Nombre d’6tudes doivent se rapporter a des populations non us- 
uelles, difficiles k d^finir. 

7. Les bureaux de recherche commerciale se trouvent sou vent dans 
la n6cessite d’^tudier des attitudes et opinions qui proyoquent des reac¬ 
tions 6motionnelles, personnelles ou morales parmi les personnes tou- 
ch6es par Tenquete. 

8. Trfes souvent, meme dans de grandes etudes sur Techello nationale, 
le bureau de recherche commerciale doit faire des estimations detaillces 
concernant des territoires relativeraent peu 6tendus du pays. Cela rend 
necessaire d’entretenir un tris nombreux personnel a horaire partiel 
reparti sur tout le pays. 

Ind6pendamment de tout point de vue theorique, il faut considerer 
les points suivants: 

1. Quels sont les problfemes auxquels Pusager des donnees desire 
avoir une r6ponse? 

2. Quels actes seront probablement bases sur les resultats dej’en- 
quete? 

3. Degre de precision requis? 

4. Importance du credit? 

En tout cas, le plan choisi doit procurer It Pusager des donnees un 
maximum d’informations pour un minimum de frais. 

lies auteurs, en une serie d’exemples, montrent comment un bureau 
de recherche commerciale resout ses problemes d’echantillonnage. Les 
exemples concernent les types de problfemes suivants: 

1. Une etude rapide non recurrente concernant une population difd- 
cile k definir, sur une mati^re causant des reactions d’ordre moral, per¬ 
sonnel et politique pour certaines des personnes touch6es par Penquete. 
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2. Une 6tude caract^sristique des relations externes d’un 6tablisse- 
ment industriel, utilisant une combinaison des methodes d’6chantillon- 
nage spatial (“area sampling”) et par quotas (“quota sampling”). 

3. Une enquete efFectu6e ^ Faide de questionnaires transmis par la 
poste, se rapportant k une population trfes speciale. 

4. Une 4tude d’un type usuel pour determiner les preferences de style 
ou de produits de groupes trfes speciaux etant ou pouvant etre acheteurs 
de certains produits, pour servir de guide k la politique de production 
et de vente. 

5. Une etude des attitudes de “cercles concentriques” de populations 

k regard d’un etablissement industriel. Le but de Tetude etait de 
guider, sur nombre de questions de detail, le programme de relations 
publiques de Tetablissement. ^ 

6. Une prediction relative aux elections presidentielles aux Etats- 
Unis, en 1944, I’aide de la niethode “pin-point”, un type d’echantillon- 
nage choix raisonne. 
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Discussion 

Professor Mahalanohis: 

Professor* Cochran mentioned yesterday that sampling statisticians 
do not i*(‘ad one another’s papers. That I think is true, but one reason 
was the blackout in India during the war. You simply could not get any 
literature. From India we did send some here, through the U.S. Eni- 
l)assy in Calcutta, up to about 1939 or 1940. Since then, we have been 
completely out of touch. And this is why 1 can sincerely say that I 
think the job done by Professor Stephan is invaluable. 1 hope it will 
be followed up, especially coming to more recent times. Going back to 
the remarks made by Professor Cochran, there has been much work on 
parallel lines; in this <‘ountry, in England, in India; but the blackout is 
still there. 

There is one asjiect of this parallel development, which is of consider¬ 
able interest from the poi^it of view of the history of science. In the 
broad fundamentals, it is encouraging that we have had not only similar 
but practically identical developments. It must offer a wide basis for 
confidence that Avorkers experimenting or developing the theory inde¬ 
pendently in different countries used often not only identical methods, 
but sometimes even identical termS; like ‘grid’, Avhich has been used in 
the United States, as we did in area sampling in India. This is the first 
postulate of scientific philosophy: If there is a truly objective method, 
workers independently should come to the same result. We haA^e that 
great confidence behind us, that in the sampling field, Ave have had an 
actual demonstration of the objectivity of the method, because of 
parallel developments occurring independently in different countries. 

Yet, the contrasts are also of considerable interest. One rather sharp 
difference iti the methods developed in the U.S.A. and in India in the 
same field of area sampling arises from differences in the economic and 
technological background of the two countries. In the ‘master-sample' 
in the U.S.A., the attempt was made to set up a strong foundation; to 
prepare a master sample out of which, at any moment, you can draw 
Avhat you like. In India, Ave have been far more ad hoc, using maps and 
each year doing practically independent sampling. The reason is that 
in India we didn't know Avhether we AA'ould be asked to do the work next 
year, and Ave didn’t have the money to get ready for next year. In this 
country a vast amount of capital expenditure was incurred in getting the 
‘master-sample’ ready, Avhich saved money in later years. The sample 
here took considerable time to prepare, whereas in India in one State, 
we had to organize an agricultural census and census of population in 
about 23 days. There was no time to make advance preparations like 



i. dTBVBKS Sfook AkD ^OSBte k. HbOttStiM 146 

the 'master-sample’. In the paper on commercial uses, we find the same 
thing illustrated; namely, the need of adapting the theory of the techni¬ 
cal method to the particular problem, and even more than that to the 
resources (in money most often, sometimes also in time) available. But 
it is good, in a primarily experimental science like sampling, that experi¬ 
mentation should go on albng with advance of theory. It does help in 
clearing up many theoretical points; it does help in offering many new 
theoretical problems. And it is all to the good, provided the need of 
unifying and developing fundamental theory is not lost sight of. 

Referring to the question of theory, I shall shoot a few questions to 
my colleagues here. How about stratification? How do you stratify? 
We should like to know. Some work is being done on that in India. For 
example: You have a fairly good knowledge of the universe through a 
previous study. Knowing this, how do you stratify? We always do it 
by some sort of—well, a truly statistical method—trial and error. 

That leads to another type of problem. Stratification obviously de¬ 
pends on the purpose in view. If we are trying to make an estimate of 
the total production of a crop, or the total population over a whole geo¬ 
graphical area, that is one problem. There is another type of problem 
which I have called, for lack of a better name, a mapping survey, where 
you do not want merely the total, but the actual distribution of some¬ 
thing over space. A simple example would be a land map, where it is 
not the total acreage under corn or wheat you require but the geo¬ 
graphical distribution of the fertility, or the rate of yield per acre. You 
may have to allocate more observations on the turning points of the 
yield surface rather than on portions where variation is small. A cer¬ 
tain amount of work done in India shows that the stratification may 
have to be on an entirely'different basis. So stratification is not some¬ 
thing which is automatically given; it is an intrinsic part of the design 
of sample surveys. This is a very important theoretical problem. 

Professor Stephan has referred to the method of what we call inter¬ 
penetrating samples. We attach great importance to this method as an 
effective control. It is simply this: In a great deal of our work with 
the area method, we split our total sample into two (or sometimes a 
' larger number of) portions. Suppose you are taking, 1,000 farms or 
5,000 little areas, for investigation; we arrange this sample in two inter¬ 
penetrating groups which we shall mark in blue and yellow. You 
collect information for the blue group and the yellow group indepen¬ 
dently. They are interpenetrating; both are random; they give two 
independent estimates of the same thing. From each you can calculate 
what Dr. Deming calls the internal error. Then you have the difference 
between the estimates based on two independent samples which you can 
compare with the 'internal error’ of the difference. This gives a most 

1 » 
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excellent check whether or not the sampling was done under statistical 
control. 

Dr. Jessen: 

I will take this opportunity to supplement a few of the ideas that were 
presented in the papers, rather than to oflFer any critical evaluation, 
since I am essentially in agreement with most of those ideas.” 

At Ames, we are conducting some research in sampling theory quite 
closely allied to sampling practice, inasmuch as most of our research is 
directed at problems met in making sampling surveys. We are at pre¬ 
sent engaged with the problem of the economics of sampling. We think 
a considerable amount of work needs to be done on this problem. As 
mentioned by Mr, Hansen, a sample design cannot really be made opti¬ 
mum until w'e know what the costs of the sampling operation are. Some 
of the results that appear to be coming out of our work indicate that a 
considerable amount of geographic distribution is usually advisable in 
most sample surveys, even though this means a considerable amount 
of outlay for travel and detailed mapping and Other facilities required 
to specify such sampling. 

On the matter of stratification, we have a little different philosophy 
towards that than that expressed by Mr. Hansen, for example. It is 
essentially this: Those characteristics of the population that can be 
easily measured, we generally prefer to use for purposes of sampling effi¬ 
ciency, in the probability of choice of sampling unit, or in the estimation 
procedure, rather than in the stratification operation; and to reserve for 
stratification those characteristics that are not so easily measured, like 
geography or soil types, or climate. By this means we think wo can 
make more effective use of all the prior information that is available to 
us. 

On the matter of area sampling, I notice that the idea is sometimes put 
forward that it requires a considerable amount of capital equipment. It 
is true that a considerable amount of money was spent in this country 
in the preparation of the master sample materials that are being used 
for a number of the samplings, by both the government agencies and 
nongovernment groups. This may mislead other countries into think- ^ 
ing they cannot carry out effective area sampling schemes because they 
don’t have this equipment. We have got to the point now where we can 
do some of the mapping on a sampling basis that we did for every county 
in the United States and can do this much more effectively than we 
thought was possible several years ago. An example of this is a recent 
sample that we conducted in Greece, where certainly we did not have all 
the elabbrate capital equipment for making area samplings. By this, I 
- [ibaeitn the mapping for sampling can be done for those particular places 



J. STBVBNS STOCK AlfD JOSEPH B, HpCHS'j;?:M 

Bnd for those partipular blocks that conje into the sample ••' Thi§ be 
done rather quickly, and eflFectively, provided the proper kind of. trajin- 
ing is given to the interviewers, together with the purpose for doing these 
operations. They are inclined to think that this work is entirely irrele- 
vant to the study, that their job is primarily one of conducting an inter¬ 
view, and not that of making maps and counts. 

Dr. Chandra Sekar: 

The All India Institute of Hygiene and Public Health, Calcutta,^ has 
recently been investigating-the possibility of applying the technique of 
sample surveys for the estimation of birth and death rates. The follow¬ 
ing scheme was tried in their experimental center covering 68 villages 
within an area of 33 square miles and with a population of 63,000. An 
investigator had to call on each household, enumerate the population 
according to community, age, sex, marital and residential status, and 
list the births and deaths which occurred inside the village in the family 
during each of the last two years. An inspector who was in charge of a 
team of four investigators had to compare the births and deatlis in the 
village as entered by the investigators with those found in the birth and 
death registration books and after field verification wherever necessary, 
work out the data into the following heads. 

1. Number of events recorded correctly by the investigator and the 
registrar = (7, 

2. Number of events recorded correctly by the investigator only = Ni, 

3. Number of events recorded correctly by the registrar only Ng, 
A supervisor was in charge of the four inspectors and sixteen investiga¬ 
tors employed for the enquiry. Except for the supervisor, local residents 
were used as field staff as they are likely to obtain a better response from 
the people. Transport and housing difficulties were also thus obviated. 

The field work lasted for eleven weeks and the per capita cost of the 
inquiry was approximately 1-1/3 annas or 2.7 cents per capita of the 
surveyed population. 

For assessing the birth and death rates, the survey provides (JiroQtly 
the population figure. The total number of births or deaths N. is: ob¬ 
tained by the formula 

C + N, + N2 + 

which takes into account the events omitted by both the investigator 
Bnd the registrar. This estimate differs only slightly from ‘‘the maxi¬ 
mum likelihood” estimate but is easier to calculate. The formula as¬ 
sumes that there is no association between the events missed by both 
persons. Special situations may be conceived when this assumption might 
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net hiold good but such are not likely to be frequent under Indian oondi- 
tiona. Investigations are also in progress to assess the reasonableness 
of the assumption and to find out methods to remedy the situation 
when it fails. 


The variance of the estimate iV' is approx 


imately equal to 1 

V PiP2 / 


where Pi + = P 2 + ^2 === i Pi P 2 respectively the 

chance for the investigator or the registrar detecting an event. 

In the above inquiry the investigator’s efficiency was not of a high 
order. 67 percent of the births of the previous year and 53 percent of 
births jof the year before that were recorded by the investigators. 51 
percent of the deaths in the previous year and 32 percent of the deaths 
in the year before that were detected by them. With 'greater lapse of 
time, there was greater difficulty in tracing the event. Deaths amongst 
persons aged below 10 years of age were missed more frequently than 
deaths of persons aged more than 10 years. Male deaths were detected 
more frequently than female deaths. The above results emphasize that 
field work will not usually yield accurate data and that suitable techni¬ 
ques have to be incorporated into the inquiry if it is to yield unbiased 
results. 

For various reasons the entire population of the Institute’s experi¬ 
mental center was covered in the inquiry described above. Another 
investigation undertaken by the Institute into the nature of correlation 
between the birth or death rates of adjoining geographical areas showed 
that to estimate the birth or death rate of a district with 1^ to 2 million 
population with a standard error of 5 percent, it will be sufficient to sur¬ 
vey only about 6 percent of the population, selected by choosing at ran¬ 
dom the required number of sample units of 10,000 individuals living in 
contiguous villages; It thus appears feasible to estimate both the birth 
and death rates with fair accuracy at the low cost of 1 pie per capita or 
0.2 cents per capita. 

To conclude, the technique of sampling appears to be very promising 
for the estimation of birth and death rates in countries where the routine 
machinery has still to be improved to yield data of sufficient accuracy. 
But the nature of the difficulties that impair the accuracy of the data 
collected in the field and the methods to overcome or allow for them have 
to be more clearly understood before this technique QOuW be efficiently 
used in practice, 


Dr. Hoijer: 

In Sweden we have used for the population census of 1945 a method of 
which may perhaps be of interest. The fundamental dat^. about 
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sex, age, family circumstances, profession, etc., we gathered from the 
whole population. We wished to have some additional information 
about education, employment, and national income; and in order to save 
time and money, we collected this information only from a part of the 
population. I should like to say some words about the method of samp¬ 
ling for this purpose. 

Fundamentally, we chose all persons who were born in the month of 
July. From them the additional information was obtained at the same 
time that the complete •enumeration was made. By advertising and 
broadcasting, the public was informed that the July-born part of the po¬ 
pulation would receive these special schedules. But it was not possible 
always to isolate the persons bom in July. For the existing families 
would have been divided; and it was essential to have the members of 
the family together. For this reason, the principle of the sampling had 
to be in some degree changed. If in a family, the oldest member was 
born in July, the whole family was selected to answer the special sche¬ 
dule. If, on the other hand, in a family the oldest member was not born 
in July, but there was another member born in that month, this family 
was not in the sample. This way, we had drawn a sample amounting 
to one-twelfth of the total population, or about 550,000 persons, spread 
over the whole country and giving a true image, I think, of the whole 
population, in respect to this distribution on sex, age, income, and so on. 

Of course, we could have done the sampling in another way, too, by 
picking from the population lists of the total census every tenth or 
twelfth person. But then the sampling would have to be made after the 
total census; and we should have had to ask the sampled person twice* 


Mr. Sukhatme: 

I wish to mention a type of sample survey, extensively carried out 
in India, in which it is our aim to utilize the existing field agencies, each 
working within its own jurisdiction, and in which, therefore, the prin¬ 
ciple of maximum information per dollar plays a relatively minor role. 

I have in mind the problem of estimating the average yield per acre. 
My country is divided into a large number of states, nine or ten; each 
state into districts, a district being approximately 4,000 square miles; a 
district into sub-divisions; and sub-divisions into what are known as 
tehsils. The ultimate unit of administration is a village (a little more 
than one square mile in area). In each village, there is an ofiicial whose 
principal duty is to collect land revenues; but who also maintains a re¬ 
gister showing the names of contributors, the area in each field, the name 
of the crop grown, and so on. 

This framework of administration determines the scheme of sampling 
almost automatically. 
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In the scheme of sampling, a village is a primary unit of sampling and 
a field within the village is the sub-unit. If we had a unit of sampling 
larger than the village, there would probably be a gain in precision. But 
we cannot adopt it because a village is the practical unit. With a larger 
unit, listings of fields would not be readily available. 

The broad structure of sampling: namely, the primary unit of samp¬ 
ling, the field that comes into the sampling; and within a field, a small 
area from which the crop is to be cut are practically determined from 
these considerations of administration. What is determined from ex¬ 
perimentation is only the number of sampling and sub-sampling units 
and their distribution. 

But here again, travel costs do not enter into account, because it is 
one of the normal duties of the existing staff to carry out these experi¬ 
ments. What we do is*to assist in applying the principles of random 
sampling under the existing conditions. 

By adopting a scheme like this, we overlook certain theoretical prin¬ 
ciples of giving equal chance to every bit of land in the population. But 
these deviations do not seem to affect the estimate of final yield; and 
if they do, we can correct for these deviations by weighting the average 
yield in proportion to the area in each village, or similarly by weighting 
the average yield from each field by the area of that field. 

One important point is the possible error arising from the human fac¬ 
tor. I have especially in mind the size of the unit of sampling that we 
can harvest from a field. 

It is well known that yields from neighboring areas are closely corre¬ 
lated. But with a small sampling unit, such as one would like tor take, 
it has been observed that we overestimate the yield, sometimes by as much 
as 20%. This point is important because we must provide the ex¬ 
isting staff with methods by which we can depend upon them to carry 
out the work so as to give precise results. 

Dr, Molina: 

There are one or two advantages in being old; in connection with the 
history of sampling, I am in a position to give Dr. Stephan the names of 
two men who did outstanding work many years ago, work of which I had 
first-hand knowledge. 

I will first mention the name of an outstanding British telephone engi¬ 
neer, Captain G. F. O’Dell of the British Post Office. O’Dell made very 
extensive sampling studies of the distribution of traffic, that is, of the 
’ way telephone calls fall with reference to time and space. The result of 
this work was material changes in British telephone practice. If Doctors 
Kendall and Yates or any other of our distinguished English guests 
would like to learn mote of the work of O’Dell, it is no use appealing to 
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O’Dell. He would disclaim any knowledge whatever of the subject/.’ 
But they can obtain information through Egon Pearson, who is some- . 
what acquainted with the work of Captain O’Dell. 

The other name is that of a distinguished American, the late Malcolm 
Rorty, a former president of the American Statistical Association. Ror- 
ty wrote his pioneer paper on the application of probability theory to 
telephone problems in October 1903. Basing our work on his pioneer 
paper, in 1905 we applied the theory of probability to the design of auto¬ 
matic telephone systems. This led to our invention of ‘‘translation of 
dialed pulses,” an invention which revolutionized the design of dial 
systems. 

But perhaps a more important result of Rorty's pioneer work, the im¬ 
petus to which was given by sampling studies, was that he created a 
friendly atmosphere in the Bell system toward probability, an atmos¬ 
phere which received with open arms the distinguished gentleman who 
introduced into the Bell System modern statistical methods and the art 
of quality control. Dr. Walter Shewhart. 

M. Vincent: 

Puisque M. Stephan fait appel a la collaboration de tous pour 
completer la documentation qu’il possfede sur I’histoire des applications 
des methodes modernes d’echantillonage, je me permettrai de lui donner 
quelques indications recueilUes a Toccasion de recherches eflFectuees dans 
le domaine de ma specialite, c’est-a-dire en d6mographie.^ Mais au- 
paravant, je voudrais dire combien nous devons etre reconnaissants 
k M. Stephan d’avoir entrepris un travail aussi ingrat. 

Sur les premiferes evaluations de la population britannique, je me bor- 
nerai k signaler Tarticle que M. Glass a consacre k ''Gregory King and the 
Population of England and Wales at the End of the Seventeenth Century"]^ 
La statistique sur laquelle etait bas6e revaluation de Gregory King avait 
6te etablie a la suite d’un Act de 1694. A peu pres exactement k la me- 
me epoque, en 1693, un “denombrement” de la population fran^aise 
avait ete prescrit; mais c’est seulement la grande enquete ordonnee en 
1697, et qui donna lieu k la redaction des fameux Memoires des inten- 
dants pour I’instruction du due de Bourgogne (1697-1700), qui fut explo- 
itee pour de nombreuses estimations de la population fran 9 aise, la pre¬ 
miere ayant ete faite par Vauban et publiee dans son Project d'une dime 
royale, en 1707. 

M. Stephan a fort justement remarque que ces premieres evaluations 
de la population constituaient de veritables Bondages. Les releves de 

» C/. Paul E. Vincent, “French Demography in the Eighteenth Century,” 

Population Studiesf Vol. 1, No. 1 (1947). 

» Eugenics Eeview, January 1946, p. 170 ff. 
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baptSmes dans les registres paroissiaux n’^taient souvent 6tablis que 
pour fournir une base h I’estimation de la population, et la determination 
du rapport existant entre les naissances et la population, dans des aires 
gibgraphiques restreintes, n’avait pas pour but de fournir un indice de 
la situation d6mographique—comme, de nos jours, le calcul du taux de 
natality—mais une Evaluation du facteur de proportionnalite k adopter 
pour Testimation du chifFre de la population. A cet Egard, le sens dans 
lequel on prenait le rapport (25 habitants pour une naissance), inverse 
de celui adopte de nos jours, est d’ailleurs symptomatique. 

La technique s’affinant, on en vint k eflfectuer de vEritables Bon¬ 
dages stratihEs. adoptant des valeurs dilFErentes du facteur de propor- 
tionnalitS pour les villes et les campagnes, et suivant les regions gEogra- 
phiques. Un exemple de Fapplication de ces mEthodes se trouve dans le 
remarquable ouvrage de Montyon intitule Beckerches et considerations 
sur la population de la France^ publiE k Paris en 1778 sous le nom de 
Moheau, un des secrEtaires de I’auteur. Mais, semblables k M. Jourdain, 
les demographes du dix-huitiEme siEcle faisaient des Bondages sans le 
savoir. Le premier qui paraisse en avoir eu conscience est Condorcet qui, 
se livrant k “quelques rEflexions gEnErales sur la mEthode employEe par 
M. Moheau” dansle Mercure de France du 5 juillet 1778, p. 35 et suiv., 
posait la question suiyante: ”Je suppose par exemple que Ton ait opErE 
sur un canton qui contient 200,000 personnes, qui Ton ait observE que le 
rapport du nombre des naissances k celui des individus est comme 1 k 
23, et qu’on en conclue que dans un pays oh il nait un million d^enfants 
par an la population sera de vingt-trois millions; je demande maintenant 
jusqu’h quel point je puis compter sur cette conclusion.” Et Condorcet 
exprimait son espoir que le moment viendrait oh les travaux des proba- 
bilistes deviendraient utiles, grace k “un homme nE avec le genie des 
MathEmatiques et celui de la Philosophie.” 

Celui qui devait fournir, cinq ans plus tard, la reponse k la question 
posEe par Condorcet, fut son collegue k TAcademic des sciences, Laplace; 
et, si Ton songe aux relations Etroites qui s'Etaient Etablies entre eux, 
prEcisEment en oe qui concerne les questions dSmographiques—ne devai- 
ent ils pas, k partir de 1783, presenter en oommun h TAcadsmie, associEs 
k Du Sejour, VEssai de La MichodiEre sur la densitE rurale—il n’est pas 
exclu que la question de Condorcet ait EtE k Torigine des travaux qui de- 
vaient oonduire Laplace k la premiEre application du calcul des proba* 
bilitEs aux problEmes soulevEs par les Bondages dEmographiques {Histoire 
de VAcadetnie royale des sciences—annee 1783-.pp. 693-702). 

Mr, Shafek 

I would like to remark on Mr. Hansen’s method of sampling of blocks. 
{ fee} that in relying on the first numbering of the blocks, (I presume 
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that the numbering of series of blocks would proceed probably 
geographically) and in taking every n’th block this would not represent 
the population exactly unless the density of the population is even over 
the area. There are some blocks, as we know, that tower high up; and 
therefore, they contain so many inmates; and therefore, the n'th. block 
in the cluster of an urban geographical area will contain many more in¬ 
habitants than, for instance, the (n+4)th block. And if the blocks or 
the streets are ordered alphabetically, there is a danger in some langu¬ 
ages that the several letters will not have the same frequency of utter¬ 
ance. For instance, if you look at a telephone directory of an Arabic¬ 
speaking country like Egypt, you will find the letter M, for instance, 
is very much more frequent than any other, the reason being that the 
name Mohammed (which relates to Islam) is very much more frequent 
than other names. Therefore, if we depend on alphabetical ordering, 
we run into bias without being conscious of it. 

1 would like to suggest a method of choosing areas, random areas. 
Supposing we have an area or a city with a map of, say, ten inches by ten 
inches square; and suppose we want, say, a ten percent sample. I 
would like to suggest a random square of one inch side spread ran¬ 
domly over this area. In order to determine the position of this 
square, use horizontal and vertical coordinates. Those coordinates will 
be determined randomly from the figures one to ten. If I have the hori¬ 
zontal axis ten inches long and the vertical axis ten inches long, I shall 
have ten coordinates, numbered from nought to nine on the vertical 
side, of which I can choose any number at random. And, therefore, I 
can assign any number of these sample squares. If I want a ten percent 
sample I can have ten such squares by choosing ten pairs of random 
coordinates. And this will give me the ten percent sample spread over the 
area of the town in a very random way. This w ill also, I believe, give 
me a chance of doing away wdth stratification of the sample. Wherever 
I take the one-inch block, 1 can make the interviews within that block. 
And if I make the interviews in the ten blocks then I shall have a ten 
percent interview, or a ten percent sample. I think this will be a 
random one. 

Dr, Yates: 

I have to thank you. Madam Chairman, for giving me the opportunity 
of making a few remarks. I was speaking yesterday on theory and I 
don’t want to say much today, but I would like to mention one or two 
items of work with which I have been concerned on the practical side. 

First I should like to mention the Survey of Fertilizer Practice. The 
reason I want to mention it is that it is a good example of what may be 
called very untidy sampling. This untidiness w^as forced on us by the 
20 



164 


INTBBNATIONAL STATlSWCAli CONBEBBNCBS: 1 S 1 


nature of the material. Had we attempted to be orderly we should have 
failed to collect the information that we required. 

The Survey of Fertilizer Practice was designed to find out how farmers 
were using their fertilizers on the different crops. The information was 
required in considerable technical detail. In addition,, soil samples 
were to be taken from soil of the fields for analysis for fertilizer require¬ 
ments. The sampling procedure we adopted was as follows: a sample 
of farms was first taken, using a variable sampling fraction so that more 
of the larger farms were secured. This part of the sampling is very sim¬ 
ple in England since we were able to obtain addressograph lists of farms 
in each county which contained a record of the acreage of each farm. 
The field workers visited the selected farms and took a sample of one 
field of each crop growing on old arable land, a similar field of each crop 
growing on new arable land, (i.e., land ploughed up since the war) and one 
or more fields of permanent grass. This part of the sampling was done 
in conversation with the farmer, making a list of all the fields classified 
by the different crops, etc. 

As you will see this results in sampling fractions which are different for 
almost every unit in the sample. This results in a good deal of compu- 
ting work in the abstraction of the information. This is an inevitable 
necessity because had we asked for information from the farmer for all 
the fields on his farm this would unquestionably have put too much 
strain on him, and had we taken a random sample of all the fields on the 
farm we should not have had a good coverage of each crop and would also 
have irritated the farmer by, for example, asking him for information 
on two or three of his wheat fields and nothing about his sugar beets. 

I would also like to mention an example of how biological and sociolo¬ 
gical problems interact in sampling. During the war we had the problem 
of determining the number of people that were about in a given area 
of a town in order to see whether air raid shelter facilities were adequate. 
The problem was of no great importance in that it turned out the 
information was never seriously required, but given the problem the 
solution is interesting and is relevant in problems of ecological survey. 

The police authorities, when confronted with this problem, always 
attempted to solve it by posting observers at fixed points with instruc¬ 
tions to count passers-by. Now it is clear that such counts will not give 
an answer to the number of people in an area unless all exits and entries 
can be covered and the counts are continuous and accurate. In fact, 
these conditions cannot be even approximately fulfilled in the case I 
have mentioned. Instead of using stationary observers, therefore, we 
proposed that moving observers should be used. Thus, for example, 
in order to find the number of people in a street one or more observers 
(depending on the extent of the crowd) proceeded down the street count- 
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ing all the people that they passed and deducting anyone who passed 
them. At first sight this sounds a difficult operation but in practice it 
proved to be quite easy. In streets with few people similar counts can 
be made from moving vehicles. The counts must be made in both direc¬ 
tions in order to allow for any predominant flow in one direction. A 
similar procedure can be used to find out the number of people in a store. 
It was actually used for this purpose and proved far more convenient 
and accurate than previous attempts based on counts of people enter¬ 
ing and leaving the store. 

Dr. Szuh: 

One of the earliest applications of scientifically developed sampling 
methods to the tabulation of the population census took place in Poland 
in 1932. Material from the population census of December 9, 4931, was 
available; but they could not wait until the complete tabulations would 
be ready. And they needed cross-tabulations not ordinarily included 
in census tabulations. The information needed was the population by 
number, age, sex, family condition, age of wife, number and age of chil¬ 
dren, and so forth. 

The sampling method was designed by Professor Neyman. Most of 
the modern sampling methods, stratification, sub-sampling, double 
sampling, were used in this investigation. Some theoretical results of 
the design of this investigation were developed by Professor Neyman in 
a paper on random and purposive sampling published in 1934 in the 
Journal of the Royal Statistical Society, 

Miss Walker: 

Prof. Mahalanobis sends up a note calling attention to the fact that 
the method of squares located at random, with the help of random 
coordinates, which was mentioned by Dr. Shafei from Egypt, has been 
used in India as a routine measure since 1937. 

Dr, Sastry: 

In the examples of the uses of modem sampling procedures given by 
the three speakers, I miss any reference to the application to the affairs 
of banks. This may, perhaps, be due to the fact that bankers in general 
are very conservative, and do not like innovations which do not give 
accurate results, but only estimates. Recently modern sampling pro¬ 
cedures were applied in certain inspections of banks in India; and 
interesting results were obtained. 

From statutory obligations, the Reserve Bank of India has to estimate 
iihe available assets of certain member banks called stable banks. A 
member bank has usually a very large number of branches spread over 
different regions of the country. Each bank has transactions with a 
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large number of constituents; in these loans, we have different collateral 
securities: for example, government bonds, equity shares, real property, 
and in some cases personal demand notes. The value of these securi¬ 
ties at the time of inspection will be different from those at the time 
when the loan was given. No doubt, the bank will have the usual mar¬ 
gins when lending the amount. But given a financial crisis, the margin 
will not be sufficient; hence, the object of the inspection is to estimate the 
total available amount of all these loans. The usual procedure is for the 
inspecting officer to select a number of doubtful branches; and in these 
offices to check loans of a particular amount. 

The available amount among these loans is calculated and the identi¬ 
cal amount is given to the uninspected bankers and unexamined loans. 
Obviously, this method can lead to serious bias in estimates of available 
assets. 

The new sampling procedure is as follows: First of all, for each bank, 
from the total number of branches a few branches have to be selected; 
and in each branch, of all the given loans, a certain proportion of loans 
will be selected at random. I am not going into the details of all this 
procedure; but I can only say that the estimates found are within the 
limits of probable error. 

Mr, Stephan: 

I have been gratified by the suggestions that have been made and hope 
that others may send me additional examples that would be helpful in 
this history. 

I wish that there had been enough time to cover the developments of 
the last ten years. There are some broad and important trends; Dr. 
Jessen has referred to the development of the economics of sampling. 
There were several early attempts to deal with problems of cost and to 
find the optimum design of a sampling operation from the standpoint of 
the cost system. A great deal of important work is now going on, and 
more will be done in the future, on that problem. It is not only a problem 
of capital investment and current cost, but one of sharing the cost of 
preparatory work among many surveys so that it may become possible 
to do sampling as part of a broad scheme of sampling projects, when 
such sampling would be too costly if undertaken by itself. That is one 
reason why the development of sampling centers at the Census Bureau,, 
Bureau of Agricultural Economics, and Bureau of. Labor Statistics, and 
many of the universities and private commercial research organizations, 
is a great step forward. It means a great deal for research to have ac¬ 
curate and economical methods of sampling available. 

There is another trend that we see only dimly now, and that is increa¬ 
sing recognition of the problem of explaining to the public how depend- 
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Rbl6 R SRmple is, Riid when it is safe to treat sample data as if they were 
absolutely accurate. We have not yet solved the problem of training 
millions of people to know what a standard error is, or fiducial limits, 
or even to recognize that a set of sample data may be dangerous for some 
purposes and safe and valuable for others. In this problem of informing 
the public, statistical organizations have a great function to perform. 

Some reference was made to the training of interviewers and of other 
people who collect the sample, in accurate methods of sampling. This 
is another important problem on which work is to be done; and it calls 
for psychological research of a high order. Coupled with it is the psy¬ 
chological problem of eliciting from respondents accurate answers to 
questions. We have before us vast and difficult problems of improving 
the accuracy of our methods of measurement. As those problems are 
solved, the advantages of accurate sampling methods will become more 
important, and more valuable. 

We are also making additional use of accumulations of data, both in 
the design of samples and in the preparation of estimates from them. 
That calls-for attention, too, and shows again a link between practice 
and sampling theory. 

Finally we are bringing together the various aspects of sampling theory 
and sampling practice into a systematized body of knowledge. In other 
words, we are dealing with a complete system rather than wdth a lot of 
separate sampling techniques. 

As to the specific comments, 1 was glad to have Dr. Molina’s refer¬ 
ences to the early work in the American and British telephone systems. 
The fact that this early work was not given greater publicity w as partly 
due to modesty, and partly due to the fact that the men who made these 
excursions into sampling were preoccupied with other problems. At 
the same time there was an interesting discussion of sampling methods, 
including considerations of cost and the development of an optimum 
sample design, among the raining engineers. They were stimulated by 
the problems in the western mines and South Africa, of estimating the 
gold content of ore, and of controlling the mining processes so that any 
leak by which the gold was being diverted might be discovered. There 
were also problems of either deliberate or unconscious contamination of 
samples; called “salting.” We sometimes have those problems today in 
economic and social sampling. 

1 am glad to have the comments that Dr. Vincent gave us, from the 
early history of demography. 1 was not unaware of some of these deve¬ 
lopments, but did not have space to refer to all of them. Laplace’s 
contribution was unique in one way: he followed methods that others 
had followed in preparing population estimates but, so far as 1 know, he 
was the first to put limits on his estimates and to give the odds that he 
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miglit be wrong by more than a certain amount. It is to be regretted 
that this lead was not followed up, because these intellectuals and ma¬ 
thematicians, predecessors of modern statistics and demography, could 
have developed a great part of modern sampling practice and the theory 
that underlies it, if they had been compelled by practical problems to 
turn their attention to it. Here again, we find the interaction of prac¬ 
tice and theory, exhibited this time by lack of sufficient practical pres¬ 
sure on the men who were capable of developing the science. 

I am grateful to Dr. Szulc for his references to Dr. Neyman’s papers, 
and to the work that was done in Poland. Dr. Neyman has stimulated 
development in sampling theory and practice in a number of important 
directions. 

Several similar tabulations of complete census data have been made 
to obtain cross-classifications that would not otherwise be available, 
notably in England and the United States. In the census of 1940, we 
used a five percent sample taken simultaneously with the enumeration, 
to get additional information about the population. But we also used 
that sample to get detailed tabulations quickly, and with adequate cross¬ 
tabulations, for information that was available for the whole population. 
It was economical, but even more important, some figures were avail¬ 
able six, eight, or twelve months in advance of the figures that were 
provided by the complete tabulations, simply because sampling methods 
were used. When the complete tabulations were made, the sampling 
system proved itself by showing very small errors. The few outstand¬ 
ing errors that did appear were traceable to changes in the coding pro¬ 
cedures, between the coding of the sample material and the coding of 
the complete census. They called attention to the fact that other sour¬ 
ces of error are frequently more important than the sampling error of 
a well-designed sampling procedure. 

Mr, Hansen: 

Mr. Suhhatme mentioned that, where he had an existent field organi¬ 
zation available to work with, the best sampling system did not involve 
necessarily the application of the theory of optimum sample design. I 
should like to emphasize what I referred to in my original statement: 
that we do not. have any theory of optimum design, such that there is 
a set of formulas in which we can put certain numbers and uniquely de¬ 
termine the optimum. What you can do, and I think Mr. Sukhatme’s 
problem comes within that framework, is make a decision as to a type of 
sampling approach. This decision should take account of the resources 
and facilities that are available. Then within the framework of this 
broad approach sampling theory will guide one to the optimum. The 
field organization available is one of the resources to be utilized, and in 
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Sukhatme's case the theory should point to an optimum design that 
makes effective use of this field resource. 

Now, with respect to the remark by Mr. Shafei, he indicated that a 
bias would result from using the methods that I had suggested if the 
population was not distributed uniformly within a city; and that if one 
sampled random squares he might avoid this bias. The fact actually 
is that neither method would be biased. Either method, properly used, 
will give unbiased results, so that the decision between one type of ap¬ 
proach and the other would be based on the information available for 
estimation, stratification, and other purposes, and which way you could 
carry out the various field enumeration procedures. Very often in block 
sampling the use of street boundaries has very substantial advantages. 

One other thing I wasn’t quite sure of in Mr. Shafei’s remarks was the 
suggestion that you might take a ten percent sample of a city by taking 
ten random areas from a group of 100. That would be a random sample, 
true enough, but if you took only ten and used such large areas that 
you had only 100 such areas in your grid and then took ten at random, 
the sample would ordinarily—even though a high percentage of the po¬ 
pulation, perhaps ten percent, was included in the sample—be based on 
such large clusters that it would be very inefficient and estimates from 
such a sample would have a large variance. But the method when used 
with small-sized clusters would be a competitor with other methods, and 
the one to be used would depend upon the circumstances and available 
facilities. 

Dr, Hauser: 

Madam Chairman, if I may be permitted two very brief observations, 
from the standpoint of one who has been strategically located for parti¬ 
cipating in, and observing a large number of social surveys. It has oc¬ 
curred to me particularly, as I have listened to the sampling papers, 
that one must leave with the notion that probably no survey ought ever 
to be approached without first raising the question of how large a sample 
is adequate for the purposes of the given survey. Resources are fre¬ 
quently wasted, through distrust of, or lack of familiarity with the effi¬ 
cient sampling methods which are available, I am sure that the re¬ 
sources now going into the collection and dissemination of statistics 
would make available a much broader range and scope of data to the 
government administrator, legislative bodies, business, labor, and other 
user of data if efficient sampling methods were utilized. The point to 
this observation is that I think that each of us engaged in the collec¬ 
tion and dissemination of statistics, were we to ask the question with 
respect to every survey, of how large a sample is adequate to the pur¬ 
pose, and use the efficient forms of sampling design which are available, 
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we could provide our consumers with considerably more data for a given 
expenditure than is now actually the case. This is a lesson flowing from 
these meetings that I think is worth pondering. 

I have a second observation, if I may be permitted to make it. It 
is that in a social survey, that aspect of methodology which has become 
the easiest to solve is that of sampling. We should be grateful for what 
has been developed in this area as an important contribution to adequate 
and eflPective results. But we must also be mindful of the great areas 
of ignorance, which remain in many other aspects of the social survey, 
and the importance of exercising the same ingenuity as is evident in the 
development of sampling techniques, to those other sources of now un¬ 
known and, in the main, unmeasurable error in the collection of social 
and economic statistics. 



t)SiVELOPMENTS IN SUBSTANTIVE ECONOMIC 
AND SOCIAL STATISTICS IN THE 
UNITED STATES 

Saturday, September /3» at 2: 00 p.m.* 

Chairman : 

Isador Lubin 


REGENT DEVELOPMENT IN MARKETING 
STATISTICS 

by Ross M. Cunningham 
Massachufietts Institute of Technology 
(United States) 

Marketing includes the various business activities involved in the 
transfer of goods and services from producer to consumer. The pre¬ 
sent analysis will bo limited to a consideration of marketing from the 
point of view of the manufacturer of consumer goods, or products which 
are used by the general public. 

Marketing research is the scientific study of marketing problems and 
makes widespread application of statistical methods. It has pioneered 
quantitative measurement in an increasing number of marketing acti¬ 
vities where opinion and hunch once prevailed, but by and large has not 
been concerned with development of statistical theory. Hence, the 
discussion of recent developments in marketing statistics will treat of 
(1) the general growth of marketing research and its organization within 
industry, and (2) significant advances in marketing research techniques 
and opportunities for further advances. 

I. Growth and Organization of Marketing Research 
IN Industry 

The substantial growth in use of marketing research by industry in 
the past fifteen years is common knowledge to marketing men but there 
is no fully satisfactory quantitative measure of this growth. The first 
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comprehensive study of manufacturers’ marketing research activities 
was made for the calendar year 1937 by the Department of Commerce 
in cooperation with the American Marketing Association.^ This inquiry 
yielded much new and valuable information but was directed to a 
relatively small selected group of companies and did hot purport to be a 
census. In 1945 and 1946 two further studies of marketing research 
within industry were made, one by the National Industrial Conference 
Board® and one by the American Marketing Association in cooperation 
with the National Association of Manufacturers.^ Tlie latter study, 
although limited to meihbers of the National Association of Manu¬ 
facturers, represented a large enough response to provide an ap- ’ 
proximate indication of the present use of marketing research among 
manufacturers. Of the 4,786 companies replying out of 13,000 on 
the mailing list, 38% carried on some marketing research either 
through an organized department or through a lino executive. An organi¬ 
zed department was defined as one or-more people engaged in marketing 
research. Of the 1,485 manufacturers of consumer goods, 15.1% had 
marketing research departments and an additional 31.3% conducted 
research through a line executive. 

These three studies, while providing invaluable data on the conduct 
of marketing research, do not furnish a satisfactory basis for measuring 
growth of the activity. There are, however, other indications of growth, 
such as the larger volume of literature, the increase in number and size 
of specialized marketing research companies, greater interest and acti¬ 
vity by various professional and trade organizations and expansion of 
the membership in the American Marketing Association. The last is a 
particularly useful measure as one of the basic objectives of this Asso¬ 
ciation is “to advance the science of marketing” and members either 
are interested in the analytical approach to marketing problems or are 
working directly in the marketing research field. Membership now 
stands at nearly 3,000, a five-fold increase since its formation in 1937 as 
a merger of two predecessor associations, the American Marketing So¬ 
ciety and the National Association of Marketing Teachers. 


^ Elma S. Moulton, **Marketing HcBearch Activities of Manufacturers,” Market 
Besearch Series No. 21, U. S. Department of Commerce, 1939. The American 
Marketing Association suggested that the study be undertaken and appointed an 
advisory committee to help in formulating plans. 

® G. Clark Thompson, “Organization for Market Besearch: Part I, Industry 
Experience; Part II, Operating Methods and Company Plans,” Studies in Business 
Policy, Nos. 12 and 19, National Industrial Conference Board, 1945 and 1946. 

■ Heusner, Dooley, Hughes, and White, “Marketing Research in American Indus¬ 
try,” •fowmciZ o/ Marketing, Yo\, 11 (1947), p. 338; and Vol. 12 (1947), p. 25. 
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Thus, there has been important general growth in use of marketing 
research by manufacturers of consumer goods and generally by all manu¬ 
facturers. There is some evidence that industrial goods producers are 
accepting marketing research at an accelerated rate. 

Space does not permit detailed treatment of the organization of mar¬ 
keting research in industry. Some few conclusions based on the afore¬ 
mentioned studies may be of interest, however, and are stated without 
discussion. 

1. Consumer goods manufacturers are more likely to conduct mar¬ 
keting research than industrial goods manufacturers. 

2. A larger proportion of consumer goods manufacturers have an 
organized marketing research department than do manufacturers of 
industrial goods. 

3. Largo companies make greater use of marketing research than 
small companies. There are relatively few separate departments in 
manufacturers with annual sales under $2,500,000. 

4. Top management is actively interested in marketing research. 
Where there are separate departments about three out of four report to 
a top level executive. 

5. Many types of marketing research are carried on but major em¬ 
phasis seems to bo placed on studies of consumer markets, of product 
lines, of distribution methods, and of advertising and other sales pro¬ 
motion methods. Substantially similar interests were found among 
manufacturers of industrial goods. 

6. The cost of operating marketing research departments for the 
companies reporting such information was 0.3% of net sales in the two 
recent studies. This rej^resents a very substantial increase over the 
rough measure provided by the 1937 study. 

7. Manufacturers with marketing research departments stated that 
they intended to expand the activities of these departments. 


II. Recent DEVEr.oPMENTs in Marketing Research 

It is next in order to consider briefly the specific applications of mar¬ 
keting research which have shown particular development over the past 
15 years and to point out opportunities for further development. The 
first step here is to list the major marketing fields in which a manufac¬ 
turer of consumer goods might conduct research studies. 

(a) The Consumer Market 

(b) Studies of Manufacturer’s Product Line 

(c) Trade Channels and Distribution Policy 

(dj Price Levels and Price Policies 

(e) Sales Promotion Methods 
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(f) Physical Distribution of Products 

(g) Financing of Marketing Activities 

(h) Public Relations and Governmental Relations 

(i) Planning of Marketing Activities 

A review of marketing research developments in terms of this outline 
reveals that they tend to bo heavily concentrated in two general fields 
—the Consumer Market and Sales Promotion Methods. These accor¬ 
dingly will be considered first and the others treated very briefly after¬ 
wards. 


The Consumer Market 

Studies of the consumer market are of substantial importance to a 
manufacturer because he has no direct contact with buyers and users of 
his product in the normal course of his business. Consumer goods typi¬ 
cally flow through trade channels, both wholesale and retail, which 
effectively conceal consumers’ buying behavior and attitudes. Fur¬ 
thermore, the measurement of flow of manufacturers’ sales from the 
shipping platform is misleading as an index of market acceptance, for 
a very considerable time lag may exist between the shipment of goods 
to a wholesaler and the movement of those same goods into consumers’ 
hands. 

(1) Increased Attention to Design of Samples: Sampling is the most 
basic and widely used statistical tool of marketing research. Almost 
never is it practical for a manufacturer of consumer goods to make a 
census of his market. 

The last few years have seen active and sometimes acrimonious dis¬ 
cussion over the relative merits of “quota” sampling versus “area” 
sampling. Quota sampling as commonly practiced is a stratified pro¬ 
portional sample (though it may be non-proportional) in which inter¬ 
viewers are assigned quotas of the various strata desired. Thp inter¬ 
viewers may be instructed to work in certain territories but are usually 
allowed discretion in selecting interviewees so long as these conform to 
quota requirements. 

The area sample is derived by dividing the market being studied in¬ 
to small geographical areas, selecting a sample of these at random, and 
within each such area selecting a random sample of individu^s or house¬ 
holds to be interviewed by appropriate sub-sample* design. Call-backs 
are made until coverage is as complete as possible. Area sampling 
in its purest form does not require advance knowledge either of the 
population being investigated or of strata which may be relevant. 
Closely related to area sampling is the situation in which the population 
is known, and the units can be identified in a manner which permits 
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selection of a random sample. Interviewers then are assigned lists of 
individuals or addresses. The inevitable geographical scatter of this 
sample design re.sults in high travel costs. 

It is not appropriate in this paper to review the arguments pro and 
con of quota and area sampling. Some of the discussion has certainly 
arisen through lack of sufficient understanding of the other side’s point 
of view. Statisticians have deplored quota sampling yet have not 
always been close enough to day-to-day operation of surveys and to the 
usefulness of their results in actual practice to appreciate fully the im¬ 
portance of practical “know-how.” On the other hand, practitioners 
have been too much influenced perhaps by higher costs of other sample 
designs, by the apparent workability of methods currently used, and 
by the difficulties of undertaking new methods. 

This discussion appears to be subsiding as there is wider recognition 
that the sample design should be governed by the particular circums¬ 
tances of the investigation and that the use of any single design for a 
wide variety of studies is likely to be either inaccurate or unnecessarily 
costly. The degree of knowledge of existing market behavior and the 
factors which cause this behavior is important in designing a sample. 
Stratification of a sample without proof of relevance of the strata selected 
will not reduce sampling error, except through sheer coincidence. The 
proportion of total households using a type of product and the variabi¬ 
lity in conditions of use between households are also important factors. 
A widely used product with essentially the same applications in each 
household can bo studied successfully with a fairly simple sample design. 

Furthermore, exj^erimentation has revealed that modifications of area 
sampling methods can sometimes be introduced without serious loss of 
precision and with appreciable reductions in cost. How far this can 
be carried, of course, depends upon particular circumstances. One of 
the very real needs today in sampling is intensified analysis of the various 
sets of conditions under which different types of sample design are 
appropriate. 

A second need is further study of apjdicability to marketing problems 
of the theory of sampling from non-symmetrical populations. Most of 
the statistical tests now used in measuring market samples are premised 
on a s;ymmetrical distribution of the population, yet we know that many 
market populations are highly skewed in their distribution. 

(2) Measurement of Consumer Purchases by Brands: 

Techniques have be:en developed for measuring at regular intervals 
consumer purchases of product classes in total and by individual brands. 
The A. C. Nielsen Company in the early IflSO’s introduced a method 
of measuring sales by brands across the counters of a sample of retail 
stores located throughout the United States. The results were then 
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projected to provide national totals. This service appeared first in the 
food field and later in the drug field. Stores are visited every sixty 
days by field representatives at which time physical inventories and in¬ 
voices are checked to establish sales over the period. There are also 
some other somewhat similar commercial operations in particular areas 
and a few manufacturers have set up their own store audit arrangements. 

Prior to the appearance of this type of analysis there had been spot 
studies of consumers and some use of so-called consumer juries for cer¬ 
tain aspects of product testing, but there had been no means of providing 
information at regular time periods by which the sales of individual 
brands and of the total product class could be measured. This technique, 
of course, covers only product sales through the particular type of outlet 
included in the sample. 

A second and somewhat different type of consumer purchase measure¬ 
ment is the panef of consumers who report their purchases of specified 
product classifications, usually on a monthly basis. This technique 
began to be important in the late thirties and early forties. Experi¬ 
mental panels have been operated by two of the leading advertising 
agencies, and some panels are operated commercially by marketing 
research organizations, such as Industrial Surveys Company, Inc., who 
sell the service to their clients. Manufacturers have also experimented 
with consumer panels. 

Usually the data are secured by forms which are filled out by the panel 
families, but a certain amount of regular field contact is maintained in 
verifying socio-economic classes of existing panel members and in the 
selection of new families to be added to the panels. 

Consumer panels cover purchases from all types of outlets, measure 
the oxtent of repeat purchases, measure rates of consumption, provide 
information on exposure to various advertising media, and furnish a 
substantial amount of data on the family unit. Continued develop¬ 
ment of the consumer panel technique is likely. 

(3) The Why of Consumer Buying Behavior: Although new tech¬ 
niques provide much information on what consumers are buying, they 
do not reveal much as to the “why” of this buying behavior. In the 
last few years greater use has been made of psychologists and of psy¬ 
chological investigation techniques. In this general effort the depth 
or open-ended interview has proved useful, especially as an aid in for¬ 
mulating hypotheses for investigation. There is also at least one experi¬ 
mental consumer panel in which information of a psychological character 
has been gathered on each household. Expansion of this type of work 
will undoubtedly take place. 

(4) Questionnaire Phrasing: Public opinion specialists have devoted 
considerable study to the effect of question wording on answers to public 
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opinion polls. Unfortunately, there has not been a corresponding 
amount of attention to question phrasing in the typical commercial in¬ 
vestigation. This is a field in which further work would be desirable. 

(5) Selection, Training and Supervision of Field Interviewers: The 
importance of competent field workers is self-evident, and the last few 
years have seen a considerable growth of interest in more effective selec¬ 
tion, training, and supervision. The fact that these interviewers are 
generally part-time workers complicates the problem but progress is being 
made and efforts seem likely to be intensified. 


Sales Promotion 

Marketing research in this general field has been very active both 
because manufacturers are increasingly seeking maximum return on 
their sales promotion dollar and because advertising media have used 
research as «an effective means of promoting their sales of space or time. 
Only a few of the more important types of studies can be mentioned. 
The Advertising Research Foundation, a nonprofit organization spon¬ 
sored jointly by the Association of National Advertisers and the 
American Association of Advertising Agencies, has been instrumental 
in undertaking or advising in many important studios in the field of 
advertising. 

Circulation measurements and studies of the economic and social 
composition of circulation have been frequent. One interesting analysis 
of circulation composition was carried out by the Curtis Publishing 
Company which gave the Census Bureau a sample of 10,000 households 
buying the Saturday Evening Post to match against .the population 
cards of the 1940 census, which were then tabulated in various ways. 

Under the general head of circulation measurements comes the Conti¬ 
nuing Study of Magazine Audiences sponsored by Life Magazine. 

The problem of measuring listenership to particular radio stations 
(as opposed to individual programs) is a difficult type of circulation 
measurement. The first comprehensive efforts to solve this was made 
by the Broadcast Measurement Bureau. , 

Outdoor advertising through the Traffic Audit Bureau developed 
during the I930's methods of measuring exposure of people to outdoor 
posters. More recently a pilot plant study using new techniques was 
conducted in Fort Wayne, Indiana, to secure more precise data on 
circulation values of outdoor posters and to gain information on the 
effectiveness of this advertising. 

Measurement of consumer exposure to individual advertisements 
or to editorial content has been developed in several media. In the 
case of magazines, the Paniel Starch organization conducts field 
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interviews which review the magazine page by page, noting whether 
the advertisement has been seen, whether some of it, or whether all 
of it, has been read. 

In measuring radio advertising, the Nielsen Audimeter, an electronic 
recording device attached to radios in a sample of homes keeps a con¬ 
tinuous record of the times at which the set was turned on and the sta¬ 
tions to which it was tuned. Because the device operates continuously, 
listenership can be determined throughout each minute of the program. 
The tape on the machine is changed monthly by field representatives 
who at the same visit make an inventory of the radio-advertised com¬ 
modities found in the home. 

The second major method of radio program measurement conducted 
by C. E. Hooper, Inc., is by telephone calls made at the time a x>rogram 
is on the air. A short series of questions determine whether the radio 
is turned on and the station or program to which it is tuned. A number 
of calls taken at random from a telephone book is made in each quarter 
hour and provide the sample for that time period. The sample is neces¬ 
sarily restricted to telephone homes. The entire field of radio measure¬ 
ment technique will see further changes and advances. 

The American Newspaper Publishers Association through the Adver¬ 
tising Research Foundation has been conducting the Continuing Study 
of Newspaper Reading. Studies have now been completed in over 100 
cities. These studies are spot studies and do not yield trend data for 
any particular city. They do, however, provide a measure of reader- 
ship both of editorial matter and advertising. 

Another study conducted by the Advertising Research Foundation is 
the Continuing Study of Transportation Advertising and is supported 
by the National Association of Transjiortation Advertising. These 
studies are being made in a series of representative cities and ajipear to 
be yielding much worthwhile data in a field which previously had limited 
quantitative measurements. 

Point of sale advertising is beginning to be investigated more carefully, 
often through the cooperation of retail store organizations. Conditions 
of use of such advertising often will permit carefully controlled experi¬ 
mentation which approaches laboratory work more closely than can 
most of the marketing research measurement techniques. Opportuni¬ 
ties appear good for fruitful results in this field. 

There have been fewer studies in the sales management field than in 
advertising. However, there has been real progress in developing tests 
for selection of salesmen. Also there have been slow but steady ad¬ 
vances in training methods, in establishing sales territories, and in setting 
sales quotas. In particular, there has been significant work done in time 
and duty analyses for wholesale drug salesmen. 
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In the remaining fields there have been few major developments and 
in some fields, research activity is conspicuously absent. 

Product studies have undoubtedly become more comprehensive and 
precise. Pre-testing is carried out carefully with typical consumer 
groups, and sales tests under normal marketing conditions also yield 
useful information. 

In distribution policy many manufacturers have been considering 
greater selectivity among outlets and probably there may be many un¬ 
published studies. A chief disappointment to students of trade channels 
is the failure of Congress to pass necessary legislation for a census of dis¬ 
tribution. Business must come fully awake to its responsibilities in 
asking for government information which it wants and needs. In the 
absence of up-to-date information counts by some newspapers of numbers 
of retail outlets of various types in the shopping centers throughout a 
city will prove helpful. 

Little research is going on in the field of pricing and this is one of the 
really important gaps. In particular, we need better ways of establish¬ 
ing prices for new products. 

Little activity of significance is evident in physical transportation 
and financing fields, but it must be recognized that research work in these 
fields tends to be done by other agencies than marketing research de¬ 
partments of manufacturers. In public relations, however, marketing 
research has been of growing assistance. Also, the marketing research 
department has tended to play an increasing role in the planning of 
marketing activities. 

Government and Other Published Data 

Little mention has purposely been made of published data from gov¬ 
ernmental and other sources. It is clear t.hat marketing research relies 
heavily upon such information and also clear that the usefulness, quan¬ 
tity, and currency of such data are increasing. The government agen¬ 
cies are aware of the needs of marketing men and have sought their 
counsel in planning for future activities. These programs will be cover¬ 
ed by the following speakers and need not be treated here. 


Resume 

L’analyse des marches dans Findustrie manufacturi^re a pris une 
forte extension au cours des quinze derni^ies annees et continuera k se 
d6velopper. Les entrepreneurs la considhrent de plus en plus comme 
6tant de trfes grande importance. 
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Les techniques de Fanalyse des marches ont niontr6 leur plus grand 
d6veloppement dans des etudes concernant les matches de consomma- 
tion et les m^thodes de d^veloppement de la vente. 

En matifere de inarches de consommation, les d^veldppements ont 
concern^ principalement la procedure d’echantillonnage, la mesure 
des achats par marque et Fanalyse de ces donnees selon d’autres fac- 
teurs. On procfede k des enquetes sur les aspects psychologiques des 
reactions des acheteurs. II serait desirable d’etudier davantage la re¬ 
daction des questionnaires et la formation d’enqueteurs. 

En matifere de d6veloppement de la vente, la publicity a ete le plus 
important domaine de recherches; des 6tudes ont aussi ete coneacrees 
k la circulation et sa composition et k la mesure dans laquelle les diffe- 
rente formes de publicite agissent sur le public. Des analyses concer¬ 
nant le temps et les quotas des vendeurs ont forme un developpement 
notable dans le domaine de Forganisation de la vente ainsi qu’un plus 
grand usage de tests pour le choix de vendeurs, mais il est necessaire 
d’6tendre les recherches dans ce domaine. 

Dans d’autres domaines: canaux de distribution, fixation des prix, 
distribution physique, financement, relations avec le public et le gou- 
vernement, et la planification des marches, Fanalyse ne montre pas de 
d6veloppement d'ordre comparable. Les importants pioblfemes que 
pr6sentent ces divers domaines prouvent qu’il est d68irable d'intensifier 
les recherches. II est particuliferement urgent de d6velopper Fanalyse 
en ce qui concerne la fixation des prix, sp6cialement de produits 
nouveaux. . 



PROGRAM OF THE CENSUS BUREAU 


by Philip M. Hauser 

Deputy Director, Bureau of Census 
(United States) 

The statistical program of the Bureau of the Census has been under 
careful scrutiny by its administrative and professional staff during the 
past several years. The program, procedures, and management of the 
Bureau have been evaluated with a view to: (1) maximizing the use¬ 
fulness of the Census product to consumers of the data; (2) improving 
and modernizing methods and techniques; (3) increasing administrative 
efficiency. Although many important substantive, methodological, 
and organizational changes have occurred in the Bureau of the Census 
in recent years, many of them stimulated or necessitated by the require¬ 
ments of war, the task of designing a useful, reliable, balanced, and effi¬ 
ciently engineered product is a continuous process and is still actively 
under way. 

The statistical work of the Bureau of the Census falls into six distinct 
fields which are the basis for the organization of six of the Bureau’s, 
twelve divisions. These fields are population (including the labor force 
and housing), agriculture, industry, distribution (including wholesale, 
retail, and service trades), government statistics, and foreign trade. 

In all these fields, with the exception of foreign trade, the program 
can be considered in two distinct phases: (1) the collection and publi¬ 
cation, of complete census or benchmark information;-(2) the collection 
and publication of current information. In the field of foreign trade, 
monthly statistics are collected and disseminated on a continuous basis. 

In response to increasing needs for current information of Govern.-, 
ment Agencies at Federal, State, and local levels, of business, of labor, 
and virtually every other aspect of American life, increasing emphasis 
has been placed upon current statistics. In fact, with respect to most 
of the program of the Census Bureau, it may bo said that emphasis has 
been shifted from complete census statistics largely for the historical 
record, to current statistics for current use. This shift in emphasis 
has of course placed a great premiun on speed and clarity in the collec; 
tion and presentation of data. It has become a major objective of the 
bureau to make statistics available as soon as possible after the date 
to which they apply, and in a form in which the contents may be easily 
comprehended. 
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Thb Substantivb Progbam 

The substantive program of the Census Bureau can be considered in 
two parts: first, general demography including population and agri¬ 
cultural data; and second, general business and economic statistics. 
These categories are not mutually exclusive but they provide an effective 
basis for administering the work of the Bureau. 

At the present time, under the law, a complete population census is 
taken decennially in the years ending in “0** and a complete census of 
agriculture quinquennially in the years ending in ‘'O’* and “5”. 

In recent years, important developments have occurred within the 
Bureau in the preparation of current population information including 
information on the labor force and housing in addition to the inter-censal 
and post-censal population estimates which have been prepared over 
a long period of time. A sample survey of the population of the United 
States is being taken on a monthly basis to provide, for the nation as 
a whole, current information on persons in the labor force including the 
employed and the unemployed and their general characteristics, such 
as age, sex, occupation, industrial affiliation, class of worker, hours of 
work, and duration of unemployment. This same sample survey also 
furnishes current information on the general characteristics of the popu¬ 
lation including family composition, school enrollment, and migration, 
and on the characteristics of housing. The compilation of such infor¬ 
mation on a monthly basis through a canvass of the population has 
become feasible only as a result of recent developments in the theory 
and practice of sampling human populations. The types of statistics 
indicated are based on a small sample of 25,000 households selected to 
represent the entire population of the United States. 

In the field of agriculture, current statistics on crops, livestocks, and 
characteristics of farms and farm population are obtained primarily 
through the Department of Agriculture. The Census Bureau, however, 
doe3 collect current data on cotton ginning and fats and oils. 

Plans for improving the usefulness of statistics in the field of popu¬ 
lation and agriculture include the possibility of a quinquennial census 
of population to be taken simultaneously with the quinquennial census 
of agriculture. (A simultaneous census of population and agriculture 
occurs now only in the years ending in “0**). Also being considered are 
an annual sample census of population and agriculture in the intervening 
period which would be adequate to report population, labor force, and 
housing data for states, important cities, and metropolitan areas, urban, 
rural farm, and rural nonfarm population of the states, and the popu¬ 
lation gf smaller cities by citj?^ size groups. The proposed annual sample 
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census of agriculture would provide data on crops, livestock, charac¬ 
teristics of farms, and farm population by regions and states. 

In the general business and economic field, there is conducted at the 
present time a decennial census of distribution (including the wholesale, 
retail, and service trades) for the years ending in “9”; census of mineral 
industries for the years ending in “9”; and a census of state and local 
governments for the years ending in “2”. The census of manufactures 
is authorized biennially, and is taken to cover industrial activity in the 
odd years. Experience has shown that this program is not adequately 
bfiblanced in the light of consumer need, and there is now pending in the 
Congress of the United States new legislation which would authorize a 
quinquennial census of distribution, manufacturing and mineral indus¬ 
tries and also a new census of transportation, excluding railroads (for the 
years ending in “7” and “2”). It is to be noted that it is proposed to 
time these operations so as to avoid coincidence with the population 
and agriculture censuses and thus even out the administrative load 
of the Bureau. 

The current program in business arid economic fields has been greatly 
developed in recent years, although it has been cut back considerably 
this year through reduced appropriations. Expansion of program has 
occurred particularly in the field of current statistics on manufacturing 
and in distribution. In the field of manufacturing, current statistics on 
production and shipments and other information is made available for 
important commodities on a monthly, quarterly, or annual basis, depend¬ 
ing on the importance and volatility of the industrial activity involved. 
In the field of distribution, current statistics are made available on 
changes in the volume of sales or receipts in retail service and wholesale 
trades together with statistics on inventories in wholesale trade on a 
monthly basis and retail trade annually. 

Monthly statistics are made available on the import and export trade 
of the United States including quantities and dollar values, together 
with supplemental information on vessel and air shipments, Vessel en¬ 
trances and clearances, and gold and silver movements. The foreign 
trade data are made available by commodities and by countries of desti¬ 
nation and origin. 

Current information is also made available .on revenues, expenditures, 
and employment for state and local governments. 

Although the Census Bureau is the largest general statistical agency 
in the government, its program is but a portion of the total Federal 
Statistical program which is a greatly decentralized program. The 
statistical output of the Bureau of the Census both supplements, and is 
supplemented by, the programs of other agencies. To obtain a com¬ 
prehensive view, thefejofe, of the statistics available in any given field. 
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it is necessary to study the program of other agencies as well as that 
of the Census Bureau.^ 

Methodology 

Much of the substantive program which is in effect or which is under 
consideration is possible because of the methodological advances based 
on research in the Bureau of the Census and in the statistical field in 
general. 

Among the more important of the methodological improvements to 
which the Census Bureau has made important contributions are the devel¬ 
opments in the field of sampling. Important innovations both in theory 
and in practice have made it possible to design highly efficient samples 
not only for human population but also for business and industrial 
establishments. Efficient use of sampling methods have resulted in 
great reductions in costs; in increased speed in collecting, tabulating, 
and publishing results; and in improved quality of data because of the 
way in which experimental and research work has been facilitated. 

Another field of importance in producing speedy, accurate, and low- 
cost statistics is machine tabulation. The punch card method of tabu¬ 
lation had its origin in the Bureau of the Census which still designs and 
produces much of its own tabulation equipment. Continuous search 
for improvement in tabulation equipment and technique has produced 
great dividends in the reduction of cost and increasing the speed and 
accuracy of tabulation. At the present time, among other develop¬ 
ments, an electronic computing and tabulating machine is under cons¬ 
truction which may completely revolutionize census tabulation tech¬ 
niques. 

Important developments have also occurred in the Census Bureau’s 
cartographic work. Good maps are essential for successful census under¬ 
takings. Among the more important recent developments in this area 
of the Bureau’s work is the utilization of aerial photographs and detailed 
maps for urban areas showing individual structures on city blocks for 
sample selection and enumeration control. 

Another development worthy of at least mention in'passing is the 
utilization of methods of offset reproduction for the publication of the 
census reports. The use of these cheap quick methods of reproduction 
has made it possible greatly to increase the volume of statistics published, 
without increasing costs. 

' The recent volume 0<yvern/ment Statistics for Business Use, edited by P. M. 
Hauser and W. R. Leonard (John Wiley & Sons, New York, 1946) presents a 
comprehensive picture of many of the major types of statistics available from 
the Federal Government* 
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The statistical output of the Bureau of the Census is so large and 
varied that it is important that there he maintained a systematic cata* 
logue of publications. A Catalogue and Subject Guide is available for 
the year 1946, and will be issued annually hereafter. In addition, a 
monthly list of publications is also issued. A study of these catalogues 
is the first logical step in getting acquainted with the statistical program 
of the United States Bureau of the Census. 


Resume 

Le programme, les methodes et la gestion du Bureau de Ilecensement 
ont ete soumis a un examen au cours dcs derni^res annees dans le but: 

1. d’augmenter Tutilite des resultats pour les usagers des chifires; 

2. d’ameliorer et moderniser les methodes et techniques; 

3. d’angmente** Tefficience administrative. Bien que d^importants 
changements dan‘3 le programme, la methodologie et Toiganisation aient 
et6 apportes ces derniferes annees, beaucoup d’entre eux ayant ete 
stimules ou rer dus necessaires par les circonstanccs de guerre, la tache 
de projetcr des plans utiles, surs, equilibres et efficients, est un proems 
continu, dont on s’occupe encore activement. 

Les activites statistiques du Bureau de Recensement embrassent six 
domaines distincts: population (y compris main d’oeuvre et habitations), 
agriculture, Industrie, distribution (y compris le commerce de gros, de 
detail et services personnels), administration publique, et commerce 
exterieur. Pour les cinq premiers domaines, le programe pent etre divise 
en deux phases distinctes: (1) la reunion et la publication de donn^es de 
recensement, (2) la reunion et la publication crinfoimations courantes. 
hln mati^re de commerce exterieur, des statistiques mensuelles sont 
r6unies et distribuees d’ui>e maniere continue. Les statistiques courantes 
occupent de plus en plus la premiere place, de sorte qu’une grande 
importance doit etre attachee h la reunion et presentation rapide et claire 
des donnees. 

Programme de travail, 

Presentement, un recensement complet de la population a lieu tons les 
dix ans dans les annees dont le dernier chiffre du millesime est un 0, et 
un recensement complet de Tagriculture a lieu tous les cinq ans dans les 
ann6es dont le mill68ime se termine par un 0 ou un 5, Un releve par 
sondage de la population des Etats-Unis est fait mensuellement afin 
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de procurer, pour Tensemble du pays, des renseignements actuels sur 
la main d’oeuvre et sur des caract4ristiques g6n6rales de la, population. 
Ce relev6 est bas4 sur un 6chantillon restreint de 25,000 manages. Des 
plans tendant k am^liorer Tutilit^ de statistiques demographiques et 
agricoles comportent la possibility d’un recensement quinquennal de la 
population oper^ simultanyment avec le recensement quinquennal de 
Tagriculture. On consid^re aussi la possibility d’un recensement annuel 
de la population et de Tagriculture par la mythode de sondage. 

Dans le domaine yconomique et des affaires, on opfere, pour le moment, 
un recensement dycennal de la distribution pour les annyes dont le miliy- 
sime se termine par un 9; un recensement de Tindustrie minifere pour les 
annyes dont le miliysime se termine par un 9; et un recensement de Tadm- 
inistration des Etats et des administrations locales pour les annees dont 
le miliysime se termine par un 2. On est autorisy k effecteur un recense¬ 
ment de Tindustrie manufacturifere tons les deux ans; il se rapporte k 
I’activity industrielle dans les annyes impaires. Une nouvelle lygis- 
lation est en pryparation qui autorisera un recensement quinquennal de 
la distribution, de Tindustrie manufacturifere et des industries miniferes, 
et aussi un nouveau recensement du transport, excepty les chemins de 
fer (pour les annyes dont le miliysime se termine par un 7 et un 2). II est 
k remarquer que Ton se propose de fixer Typoque de ces recensements 
de maniyre k yviter qu’ils coincident avec le recensement de la population 
et le recensement agricole, et, par consyquent, de repartir d’une manifere 
uniforme le niveau d’activity. 

L’extension du programme de statistiques courantes yconomiques et 
des affaires a eu lieu particuliferement dans le*. domaine de Tindustrie 
manufacturiire et de la distribution. Des statistiques mensuelles sont 
ytablies sur Timportation et Texportation aux Etats-Unis comprenant 
les quantitys et la valeur, en meme temps que des renseignements suppiy- 
mentaires sur les transports par mer et par air, les entryes et sorties de 
navires, les mouvements de Tor et de I’argent. Des dbnnyes courantes 
sont ygalement rassembiyes sur les recettes, les depenses^et le peisonnel 
des gouvernements locaux et .des Etats. 

Mithodclogie, ' 

Parmi les amyiiorations mytbodologiques importantes auxquelles le 
Bureau de Recensement a contribuy dans une large mesure, ilfaut signaler 
les dyveloppements dans le domaine de Tychantillonnage. Un emploi 
efiGlcient de mythodes d’ychantillonnage a permis une forte ryduction des 
frais, une augmentation de la rapidity dans la reunion, la tabulation et 
la publication des rysultats; et une amyiioration de la quality des don- 
hyes par suite de la facilitation du travail expyrimental et de recherche. 
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Un autre domaine important pour I’obtention de statistiques rapides, 
sftres et a peu de frais, est la tabulation mecanique. La methode de 
tabulation au moyen de cartes perforees a son origine au Bureau de 
Recensement. Une machine electronique calculatrice et tabulatrice, 
actuellemcnt en construction, pourra causer une veritable revolution 
dans la technique de la tabulation de donnees do recensements. 

D’importants developpements ont ete egalement realises dans le tra¬ 
vail cartographique du Bureau de Recensement; I’emploi de photogra¬ 
phies aeriennes et de cartes detaillees de territoires urbains montrant la 
structure de blocs, aux fins de la selection d’6chantillons et le controle 
d’enumerations. 

La production statistique du Bureau de Recensement est si large 
et si variee qu’il est important de maintenir un catalogue systematique 
de ses publications. Un catalogue et index des matiferes est disponiblc 
pour Tannee 1946; il sera public anmiellement par la suite. En outre, 
une liste de publications parait mensuellement. 
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THE PROGRAM OF THE U. S. BUREAU OF 
LABOR STATISTICS 

by Ewan Clague 
Commissioner of Labor Statistics 
(United States) 

The United States Bureau of Labor Statistics is one of the principal 
agencies in the Federal Government for the collection and analysis 
of current economic statistics. It is one of our oldest continuing sta¬ 
tistical organizations, and, through the 60 years of its experience, has 
gradually been given responsibility for a broader field of work than 
is suggested by its name. Its work is not restricted to labor statistics 
in a limited sense but, rather, covers what might generally be described 
as industrial and economic statistics of importance to the welfare of 
wage earners and of industry. Its charter, in American law, is a 
broad one: 

I 

“...to acquire and diffuse among the people of the United States 
useful information on subjects connected with labor, in the most 
general and comprehensive sense of that word, and especially 
upon its relation to capital, the hours of labor, the earnings of 
laboring men and women, and the means of promoting their 
material, social, intellectual, and moral prosperity. 

Under this broad charter its program has been constantly changing 
oyer the 60 years of its existence to keep pace with changing times. 
Today its work is divided into two important sections—the publication 
of monthly or quarterly economic statistics on a prompt and current 
basis for such important aspects of the American economy as indus¬ 
trial employment and pay rolls, prices and cost of living, earnings of 
American wage earners, industrial accidents, and the number of work 
stoppages. In addition, it covers a wide field of economic analysis 
growing out of these and other data in order to present the results of 
'fact-finding surveys bearing upon policy questions in the field of labor. 

One important fact must be kept in mind in considering the statis¬ 
tical program of the Bureau of Labor Statistics: it has no compulsory 
powers to obtain reports. It has no regulatory powers; it enforces no 
law. All of the basic data that it collects are provided on a voluntary 

> June 13, 1888, c. 389, sec. 1, 25 Stat. 182; Mar. 4, 1913, o. 141, sec. 3, 37 
Stat. 737. 
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basis. The Bureau must therefore frame its program in such a fashion 
that the importance of its work as a fact-gathering agency will commend 
itself to industry and to labor so that they will supply the basic data 
upon which its statistics and its economic reports are based. The data 
reported by industry, labor and individuals to the Bureau are kept con¬ 
fidential and are never divulged without written consent of the original 
reporter. We in the Bureau regard this voluntary cooperative report¬ 
ing structure as a groat asset in a democracy. It has enabled the Bureau 
to get accurate statistics for information purposes during the war at 
a time when some regulatory agencies found it difficult to do so because 
of fear on the part of the reporters that they, as individuals, might be 
penalized for some infraction of the law, often unwitting. 

For this reason the collection procedures of the Bureau of Labor Sta¬ 
tistics which I wish to discuss today may not have direct applicabi¬ 
lity for governmental agencies in countries where fact-gathering func¬ 
tions may rest upon authority to regulate or to compel reports. Our 
procedures may be more directly applicable to those used by private 
research organizations elsewhere. Nevertheless, I hope that some of 
the lessons that we have learned in our 60 years of experience will be 
of value to you even though the nature of our powers and our prob¬ 
lems is different from yours. After all, statistical methods are uni¬ 
versal to a high degree. 

In discussing the Bureau’s program today I want to describe in some 
detail both the substantive kinds of work that are undertaken and 
the technical phases of the program which are perhaps of greater con¬ 
cern to you—that is, the purely scientific or statistical procedures such 
as those involved in collection of data, sampling, the analysis of variance, 
and index number construction. The latter, unfortunately, are per¬ 
haps less publicized and less well-known than are the substantive 
aspects of our work. Accordingly, after a brief review of the Bureau’s 
history, I shall consider first the substantive and later the technical 
aspects of the statistical programs upon which we have been working. 


Histobicaii Backgbound of the Bubbau of Labob Statistics 

In response to increasingly wide demand in the United States for 
information of interest concerning labor, the ‘‘Bureau of Labor” was 
established in 1885 as part of the work of the Department of the Interior. 
When on March 4, 1913, a Department of Labor with executive rank 
was created, the Bureau of Labor Statistics, already 28 years old, was 
established as a part of the new Department. From 1913 to the pre¬ 
sent the Bureau has remained with the same basic functions as a 
part of the Department of Labor. 
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From the very beginning, the major projects of this Bureau have 
revealed both the wide variety and the comprehensive nature of the 
interest in information on labor and industrial development in the 
'United States in the latter part of the 19th century. Its program in 
* those early days was guided by the intent of Congress that it should 
be comprehensive, and no task in the economic or sociological realms 
was too large to undertake; nor did there appear to be any areas of inte¬ 
rest to labor which were barred from study by this new research orga¬ 
nization.* 

The first ten annual reports, issued between 1886 and 1895, dealt 
with the following subjects: Industrial Depressions; Convict l^abor; 
Strikes and Lockouts; Working Women in large Cities; Railroad Labor; 
Cost of Production: Iron, Steel, Coal, Textiles, and Glass; Industrial Edu¬ 
cation; and Building and Loan Associations. Various special reports 
which were made in this same period dealt with marriage and divorce, 
labor laws in various States in the United States, and a variety of labor 
problems and methods of handling them in other major countries of the 
world. The first large-scale comprehensive study of wage-earner ex¬ 
penditures was made as early as 1901, and even in terms of modern 
techniques it was excellently conceived and carried out.* While some 
of these functions have long since been assumed by other agencies, 
most of them are still principally a concern of this Bureau. 

In addition to these annual and special reports, under the direction 
of Carroll D. Wright, the Commissioner, the “Bureau of Labor’’ in those 
early years served as an important statistical and research arm 
for the United States Congress in conducting such special investigations 
as that for the Senate Committee on Finance on retail prices and wages. 
This type of function still continues.® 


* Eighteenth Annual Report of the Commisaio'ner of Lahore “Cost of Living and 
Retail Prices of Food” 1903, Washington; G.P.O. 1940; Department of Commerce 
and Labor Document No. 23, “Bureau of Labor.’* 

* The description of the need for this research and the principal cause that led to 
the adoption of the Senate resolution might have been written in 1947. It was: 

.undoubtedly the existence of a constant demand from legislators and eco¬ 
nomic students for reliable statistics in regard to the course of prices and 
wages in the United States. The absence of such statistics has led to a con¬ 
stant and indeterminable dispute over feusts in every economic discussion. 
Without them it has been impossible to judge even with approximate accuracy 
the progress of the people of the coimtry and the changes which have taken 
place from time to time in their condition. 

“There was no data in existence by which the actual or relative status 
of wage earners could at any time be accurately measured. As no adequate 
attempt had been made to cover this vast field for inquiry, the committee 
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Th© Gxtonsion. of this sanie kind, of research on prices and wages as 
reported by th© Senate Committee was concluded in its report on 
‘‘Wholesale Prices, Wages, and Transportation*’ in 1893.4 

One of the first major studies was a report on strikes and lockouts 
in American industry between 1881 and 1886, presenting details by 
states, industry, and causes of strikes, and amount of wages lovst by the 
workers involved in the strikes. From this almost monumental first 
task the industrial relations work of the Bureau of Labor Statistics 
has grown. Simultaneously with the developing complexity of indus¬ 
try, working agreements have become increasingly complicated and re¬ 
quire much more comprehensive study and analysis. 

Over 50 years ago the first simple studies of productivity in American 
industry were started by the Bureau. Rapidly changing technology 
in the production of many goods, it was recognized, had profoundly 
affected the demands from labor and dollar distribution among the 
various industries and different occupations in the United States. It 
had even then long been realized that increasing productivity was the 
key to the higher wages paid in the United States and to the high 
American standard of living. These studies on productivity, both in 
their substantive and technological phases, still represent an important 
part of the Bureau’s program. 

With the passage of time it became clear that certain basic statistics 
with respect to major economic facts must be regularised and that 

were impressed with the necessity of exercising great care in the conduct 
of the important investigation committed to their charge.*’ 

The inquiry for this period was directed to the ascertainment— 

“First. Of the course of retail prices of two hundred and fifteen articles 
of general consumption in seventy cities and towns in different parts of the 
country. 

“Second. The course of wholesale prices for the same articles at seven 
principal distributing centers. 

“Third. The farm prices of loading agricultural products at representa¬ 
tive points selected by the Department of Agriculture. 

“Fourth. The relative rates of wages in the cities and towns where price 
statistics were collected in fifteen general occupations. 

“Fifth. The course of wages in special industries. 

“Sixth. In addition to the inquiries as to the course of prices and wages 
in the United States, the Committee, through the agents of the Department 
of Labor, undertook to collect similar statistics for retail prices and wages in 
Great Britain covering the same period.” 

(“Retail Prices and Wages,” Senate Report No. 986, 1st Session, 52nd Congress, 
Part 1, pp. i and ii.) 

♦ Senate Report No, l?94, Finance Conpnittee, 2nd Session, 62nd Congress. 
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continuous series of statistical information must be developed and 
regularly published. The realization of the various statistical series that 
were important in appraising the condition of labor came only over 
many years. For instance, the first series on industrial employment 
assembled by regular reports from business firms were started in 1923; 
the wholesale price series were begun in 1902 (and were subsequently 
carried back to 1749); and the first cost of living index was published 
in 1921 and later carried back to 1913. Some of these series were 
developed because of recognized needs during x)eriods of i)eacetime in 
the United States. Great impetus to many of them, however, was given 
by the statistical needs of World War I, the long depression of the 1930’s, 
and of World War II. 

Review of this early history of the Bureau shows that the program 
of the Bureau of Labor Statistics was one which basically dealt with the 
development of statistical series as need for them became apparent 
and with specific investigations designed to answer imj3ortant economic) 
and social questions of the day, as they affected labor. It is in reflec¬ 
tion of such historical background that the current substantive and 
technical program of the Bureau has meaning. 


Current Substantive Program of the Bureau of Labor Statistics 

Of first priority today, though not necessarily of the greatest impor¬ 
tance, is the maintenance of the many recurrent statistical series which 
have been developed by the Bureau. I shall not take time here to des¬ 
cribe them in any detail or to discuss the stimulating statistical problems 
which they involve. I have asked that copies of the Monthly Labor 
Review be made available to all who would like them, so that you can 
review the principal statistics which are published month after month 
in its “Current Labor Statistics” section. Although all of the statis¬ 
tical series that the Bureau produces are not printed in this section, the 
major ones are there. They have been classified for convenience into 
the following‘6 major groups: 

1. Employment and Pay Rolls, reported voluntarily every month by 
about 120,000 business establishments in all principal lines of trade and 
industry, in cooperation with state agencies. 

2. Related data on labor turnover in manufacturing industries. 

3. Hours worked and weekly and hourly earnings of factory and other 
workers. 

4r Prices and Cost of Living, including the official indexes of whole- 
aale prices, weekly and monthly, and the monthly index of consumers’ 
pr^es for 34 large cities and the U. S. average, . 
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6. Work stoppages in American industry and the man-days of idle¬ 
ness they cause, 

6« Building and constvuction of various types, undertaken each month 
by private and public agencies and individuals with particular empha- 
sis on home building. 

Other important series, issued less frequently, are on productivity in 
certain manufacturing industries, industrial accidents, and wage rates. 

In addition to the development and maintenance of these statistical 
series, the Bureau continues to have responsibility for a wide variety of 
comprehensive investigations dealing with many phases of American 
labor and industry, and of international labor problems as they impinge 
upon domestic issues. 

These include periodic comprehensive studies of wage rates and wage 
structures and' of price structures; the outlook for employment oppor¬ 
tunities in various occupations and industries; a new series of reports 
on mah-hours required to turn out certain representative products of 
American industry; studies of the effects of long working hours; and 
of the production of impaired workers in industry. Most of these stu¬ 
dies are conducted solely by the Bureau of Labor Statistics, but, in addi¬ 
tion, it continues to act as a special statistical service agency for Con¬ 
gress and for other governmental and private agencies. Just before 
the war, for instance, the Temporary National Economic Committee 
—a joint legislative and executive body—asked the Bureau to make a 
number of studies dealing especially with problems of prices.*^ Some 
of these were landmarks of research in their fields. Throughout the 
war special studies were conducted for the War Labor Board, the Army 
and Navy, the War Production Board,the Office of Price Administration, 
and the housing agencies, thus avoiding the necessity for organizing 
separate and duplicating statistical staffs in those agencies. As the 
war ended and the economy of the United States returned gradually 
to a peacetime basis, the nature of these special projects changed, as 
such a program must always change if it is to meet the needs of the times. 
Thus, for example, the Bureau prepared for the Advisory Committee 
of the Office of War Mobilization and Reconversion a comprehensive 
analysis of annual wage payment plans in order to provide informa¬ 
tion for unions and industries which were interested in guaranteed annual 
wages. ’ A special study was also made of the experience of workers and 
their families who migrated to war production centers, lived through the 

® “Price Behavior and Business Policy,” Monograph 1; “Hourly Earnings of 
Employees in Large and Small Enterprises,” Monograph 14; “Geographical 
Differentials in Prices of Building Materials,” Monograph 33; from the Inves¬ 
tigation of Concentration of Economic Power by the Temporary National Economic 
Committee. 
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period of high'~wages,^and after the war were forced by circumstances 
to remigrate to peacetime production centers. 

At the request of the Congress, the Bureau in the past two years has 
been working on the development of a new wage earner’s budget. In 
the past, family budget studies have been based on subjective stan¬ 
dards. The Bureau’s current approach, by contrast, is objective—^it 
provides an econometric challengje and utilizes new methods of analysis 
which may be widely adopted in the solutions of a number of trouble¬ 
some economic and sociological problems. Another major contribution 
growing out of a project which also embodies a new method of statistical 
handling of interindustry relationships is described in our report “Full 
Employment Patterns, 1950.”® It presents an analysis of the opera¬ 
tions of the American economy in quantitative terms in such a way as 
to facilitate investigation of the long-term economic problems involved 
in the maintenance or achievement of full employment, and systematic 
testing of alternative policies, and tracing the quantitative effects of 
given expenditures through the stages of the economic process. 

Many of those studies have explored new fields of statistical methods 
and of subject matter. We hope to continue these explorations. In 
doing so, we recognize that contributions of the various other subject 
matter fields such as sociology, psychology, anthropology, public health 
and public administration must be utilized to a greater extent than in 
the past in understanding the social and economic problems around 
which our inquiries are often centered. 


TechnicA ii Pbocram of the Bureau of Labor Statistics 

So far I have dealt mainly with the substantive phases of the Bureau’s 
program. Since this is a meeting of statisticians from a variety of sub¬ 
stantive fields, I wish to spend the remainder of my time in describing 
some of our technical programs, in summarizing the general directions 
which they have taken. I hope that, later, you will have an opportunity 
to discuss some of these methods in greater detail with us at your 
leisure. 

First, I should like to direct my attention to one of the most impor- 
tant and, lately, the least emphasized of problems in statistics—how 
to get sound data upon which statistical findings may be based. Since 
no statistical study can be any better than the accuracy and integrity 
of its basic data, our emphasis has been upon the continuous improve¬ 
ment and increased efficiency of all the original facts which we use. 
This requires the careful development of definitions of terms, a clear 

• Serial No. 11.1868 of the Bureau of I^bor Statistics, U. S. Department of Labor, 
reprinted from the MonffUy Labor Review, February and March 1947. 
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description of units of counting, In price collections, for example, it 
me4ns the development of specifications giving det&iled descriptions of 
the characteristics of the commodities being priced. 

We have come to depend very strongly on field collection by agents 
of the Bureau rather than by the use of questionnaires sent through the 
mails. For example, we have spent a great deal of time on the careful 
training of our wage agents who call at factories to obtain wage rales 
paid for various occupations in order that distinctions between occu¬ 
pations using various machine processes but often called by the same 
name will be clear to them. We have experimented in the use of local 
residents who are employed as part-time agents in order also to utilize 
the resources which exist in local knowledge of situations and acquain¬ 
tance with local customs, and to save time and travel costs. 

We have directed much attention to the relationships with our respon¬ 
dents, to make sure that those who are going to supply information will 
know what the problem is, and will understand why we are engaged in 
a particular inquiry. We find' in difficult and time-consuming studies, 
particularly new inquiries, that a personal call yields better understand¬ 
ing and better statistics. In our studies involving large groups of 
householders, we have depended, for a similar purpose, upon the radio, 
newspapers, and magazines to assist us in describing the importance of 
our requests and the need for accurate information. 

Recently we have conducted some experiments with schedule design 
and have engaged in careful cross-checks of the accuracy of returns as 
we get them from mail schedules and from personal visits by our agents. 
We commend this type of check to your attention. We have lately, for 
instance, devoted considerable attention to the use of postcard sche¬ 
dules directed to householders for the collection of information on rents, 
alternating with personal visits by our agents. Another experiment has 
been with “split schedules” for obtaining information on one of 
our more elaborate inquiries, that on family expenditures. By “split 
schedules” I mean that instead of asking each respondent to provide 
information on all groups of family expenditures—a long and time- 
consuming task—we have drawn several samples and have asked one 
group to provide information on food purchases, for example, and 
another to provide data on clothing and housefurnishings purchases. 
All groups are asked to provide information on one common phase of 
their expenditures, in order to test the validity of the process. 

One systematic test of the validity of basic data has been of interest to 
the public in the United States and may be of interest to you. It concerns 
the accuracy of data on food prices at retail. Information on retail 
prices of food for the Bureau’s consumers’ price index (formerly called 
the cost of living index) is collected by personal visits of agents to food 

24 
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stores. These agents are always identified as representatires of the 
Bureau of Labor Statistics. In addition to inquiring about prices, they 
usually have an opportunity of checking price tags. To test further 
the accuracy of their reports, the Bureau on several occasions sent other 
representatives into these same stores on the same day. These second 
representatives, as unidentified customers, were furnished with money 
to purchase food of similar quality. They reported the prices which they 
actually paid. (Lest you be concerned with the disposition of these 
purchases, they were turned over to Federal institutions for use that 
very day.) In several such tests, comparisons of matched prices indi¬ 
cated a small margin of error—^never exceeding 2 percent for a typical 
bill of foodstuffs. This test had the merit of giving public acceptance 
to a series of figures that had been open to some question during periods 
when foods were scarce and prices were under wartime government 
control.’ 

The technical discussions of this Congress, in the main, have been related 
to problems of sampling. We are all happy that that can be the case, 
for we believe that in the last decade great strides have been made in our 
knowledge of samples, and in how they can be used and controlled. In 
view of the emphasis which has been given in other parts of the 
program to sampling, I shall not dwell on it here, except to say 
that the Bureau’s statistical staff has participated in these develop¬ 
ments, has modified practices in accordance with their own findings 
and those of others, and is making use of the best known sampl¬ 
ing procedures at every point possible in our program. In fact, we 
have a number of interesting procedures in double and triple sampl¬ 
ing in price collection. In collecting information on rents for family 
dwellings, various kinds of samples have been the basis for a num¬ 
ber of tests of schedule responses while they were providing basic data 
necessary for rental changes in the consumers’ price index. In employ¬ 
ment statistics we must depend upon industry sampling except in the 
case of small retail and service firms which come and go from business 
and there we have recently made use of area sampling. In our surveys 
of family expenditures we have made some unique contributions, spe¬ 
cially in regard to sample biases.® 

An important part of our current technical program is the prepara¬ 
tion of manuals describing step by step the statistical procedures which 

* For the first of these tests, see ''Appraisal of the XJ.S. Bfueau of Labor Sta¬ 
tistics Ck>st of Living Index; Appendix,*’ _ reprinted from the Journal of the 
American Statistical Association, Vol. 39 (1944), pp. 67-95. 

• " Family Spending and Saving in Wartime,” Bulletin No. 822, Bureau of J^bor 
Btatistios, U.S. Department of Labor. 
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are usel in computing our various indexes. I regret that it is impossible 
for us to provide you with printed copies at the present time. In the 
near future we expert to have our important procedures completely 
recorded in manuals. In the process of manualization, we are clari- 
fying our procedures, and obtaining greater consistency in editing, 
coding, tabulation, and calculating, and we expect important advan¬ 
tages from this process of manualization as an operating statistical 
device. 

Since the Bureau of Labor Statistics is perhaps best known for its offi- 
cial index numbers of employment, pay rolls, and prices, I should report 
to you that we have made advances in our methods of calculating index 
numbers and, at the same time, have learned from experience that less 
emphasis needs to be placed on the more elaborate formulae for the cons¬ 
truction of index numbers than upon the basic soundness of the data, 
to which I have already alluded. In our price indexes, for example, 
much progress has been made in careful definition of questions which 
the index is designed to answer, in careful analysis of the procedure used 
in substituting one price quotation for another, and in the rules for ma¬ 
king allowances for goods that went out of the market during the war 
and subsequently returned to the market after the end of the war. The 
way in which these technical problems have been handled by the Bureau 
is described in the reports of two separate committees which made in¬ 
quiry into the Bureau’s ‘‘cost of living” index—one rej^reseiiting the 
American Statistical Association and the other the President’s Commit¬ 
tee on the Cost of Living.* 

We have learned to center our attention upon the selection of data, 
upon representative coverage of the field which the index supposedly 
represents, and finally, upon simplicity in calculation. It is easier to 
explain a simple index number than an elaborate one. We have learned, 
too, that trends over time can be successfully measured with fewer items 
than we had in the past thought were necessary. For that reason we 
have moved in the direction of reducing the number of items used and 
hence the volume of calculations without in any way impairing the ac¬ 
curacy of the index. We still assemble price information on many other 
items, because of their value for analytical purposes. 

One statistical technique that has long been important in the United 
States is the development of estimates of total volumes from partial 
data—^partial either because they are based upon samples where the 
universe is difficult to test, or because there are gaps in data for certain 

• Both erf these reports are contained in “Report of the President’s Committee 
on the Cost of Living,” publiaAied by the Office of Economic Stabilization. Available 
at U,S, Qovenuuent Printing Office. 
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important parts of the area to be covered. Important examples in 
the work of the Bureau are estimates of total nonagricultural employ¬ 
ment and of the total volume of construction. Many similar situations 
must present themselves to you. In such cases, where it is essential to- 
measure not trends alone but levels, there are usually two problems: how 
to get data to fill in gaps, and how to make sure that general levels 
shown by small samples are accurate. 

In the case of the volume of employment, which is shown by industry 
groups, both monthly index numbers representing employment changes 
and estimates of total number employed are required for all important 
nonagricultural lines of work. In the United States, unlike many of 
your countries, reports on employment and unemployment through un¬ 
employment compensation insurance are only partial because certain 
occupations and certain firms are not covered by the laws. Consequent¬ 
ly, in developing totals of employment, monthly, from its limited group 
of reporting firms, the Bureau has made use of more complete reports 
from Censuses and from old age insurance and other records for certain 
types of industry and has periodically ‘‘adjusted’’ upward current figures 
to meet levels shown by these more complete reports and, using these 
comprehensive records, has rebuilt and improved its samples. In order to 
minimize the amount of adjustment, the Bureau has developed a tech¬ 
nique for anticipating this downward bias. This technique reduces the 
amount of the adjustment which is normally required. To fill gaps in 
current reports from small firms, the Bureau has developed, through 
area sampling techniques, ways of estimating changes in employment 
which take account of increases and decreases in employment due to 
changes in the number of small business establishments in existence. In 
the United States, where many individuals open small stores or service 
establishments each year and, in turn, other such establishments go out 
of business, this component of employment becomes very important. 

For construction, use has recently been made of area-type samples 
of counties in the United States to estimate the volume of construction 
going on outside the large cities, from which the only regularly reported 
data on volume of construction are available. Sample studies have 
also been made of the length of time required to complete various types 
of buildings in order to compile ratios by which it is possible to estimate 
the volume of construction actually under way at* any one time from 
what we call “building permits,’’ that is, official permits to begin cons¬ 
truction. 

I have mentioned these rather complex instances of estimates of to¬ 
tals from partial data knowing that these brief remarks can do no more 
than point to the problem, in order to give due importance to a type of 
statistical work to which we, in the Bureau, devote much attention* 
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It is often of very great significance for national policy here, as I am sure 
that it is in your countries. I hope that the Bureau’s staff can explore 
with you, while you are here, some of the techniques that you have de¬ 
veloped to meet similar problems, recognizing that each solution must 
depend in large measure upon the unique circumstances of the case. 

Unfortunately, the technical findings of the Bureau of Labor Statis¬ 
tics, as well as those of other agencies, are not too well known. They 
have not been effectively and clearly presented to the public and to re¬ 
search workers. I intend that one of my major responsibilities in the 
next few years will be to see that the contributions of the Bureau of 
Labor Statistics in these technical fields are made available both to the 
statistical profession in the United States and to you in other countries. 

Finally, I wish to go beyond the program of the Bureau of Labor Sta¬ 
tistics, as an agency, and refer briefly to some of tho more general statis¬ 
tical problems to which I hope statisticians in the Uniteil States will de¬ 
vote increasing attention. In solving them, I know that we can profit 
greatly by the experience of statisticians throughout the world. Some 
of these observations may seem elementary, but since the accuracy of 
statistics often depends greatly upon them, I believe that they are 
worthy of our most serious attention. 

First, in the field of questionnaire design, the United States, along 
with some other nations in the last 15 years, has made great strides in 
certain central statistical controls which have been exerted largely 
through control of questionnaires, and much has been done to improve 
schedule forms. I fear that we have lagged, however, in applying statistical 
controls to test the effectiveness of the arrangement of questionnaires, 
either from the point of view of accuracy and balance of response, ease 
of response, or cost of data collection. I refer here to a variety of mat. 
ters—the number of questions asked, the shape, size, color, and printing 
of the questionnaire, and other aspects of questionnaire construction. 
These are areas that need to be approached not only from a statistical 
point of view but with assistance from sociologists and psychologists, 
in addition to economists. Some approaches have been made to “deep 
interviewing” but they have so far only scratched the surface. In 
this Bureau we have also made some tentative experiments on recall 
responses, and it is our hope to conduct further tests on effectiveness 
of questionnaire design. 

It is also my opinion that problems of tabulation and calculation 
have been given far too little direct attention by leaders in the profession. 
We need to ask our mathematicians to work out the most effective 
short cuts through whatever formulae they can develop in order that our 
calculation processes may be reduced to a minimum, giving the greatest 
possible accuracy and the least effort in checking. In large government 
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agencies, such as our Bureau, these processes must be established on 
a mass production basis. I am sure that when we bend our best efforts 
to this particular task there will be an impact which has never been 
gauged on the kinds of calculating equipment with which our statistical 
offices in the United States are provided. 

Closely related to tests of schedules and development of effective 
calculation processes is the better development of cost functions of our 
various procedurea and products. In short, statisticians should turn 
their own powerful tools of analysis upon their work and its costs. 

Another very important aspect of statistical administration for which 
the profession must assume increasing responsibility is the training 
of statistical workers. This is done not merely in the colleges, but on 
the job. Here, I believe that those of us who direct statistical bureaus 
must accept a large measure of responsibility. While we have need 
of a few broadly trained and highly expert mathematical statisticians, 
most of our work is in the simpler statistical techniques where experience 
in procedures and common sense and knowledge of the study in hand 
are of great importance. We can train by insisting that every statisti¬ 
cian who undertakes a new project should describe his ultimate objec- 
tive and his methods of reaching it in writing before he proceeds; by 
making sure that his work is carefully appraised and criticized and that 
he has an opportunity to benefit from the advice of the best technicians 
available. The American Statistical Association, in the past year, has 
set up a commission to study the training of statisticians. Meantime, I 
am sure that those of us in government agencies must use every training 
device which we can obtain, including the most effective teaching 
methods and the latest visual aids. This area of study is, of course, not 
peculiar to research bureaus dealing with statistics, but for statisti¬ 
cians it presents problems of a specialized nature to which agencies 
such as the Bureau of Labor Statistics can make an important contri¬ 
bution. 

And last, I wish to suggest that we should apply statistical controls 
to the effectiveness of the presentation of our materials to the public 
—by press, radio, technical and other magazines, and other media; 
and to find out how clearly and effectively our results are, in fact, reach¬ 
ing the publics for which they are intended. It is a challenge to do so. 

In summarizing the Bureau of Labor Statistics of the U. S. Depart¬ 
ment of Labor has had a program of statistical work from which there 
has been little deviation of purpose over the last 60 years and in which 
great developments in concepts and in techniques have been made. 
There has been increased realization of our responsibility as unbiased 
technicians and research workers providing tools for effective public 
decisions. It will be our endeavm: to continue to extend our work into 



Ewan cLacIxtE 


m 


new fields as new problems arise and into new technical areas as new 
tools are needed. In order to make our work in the Bureau of Labor 
Statistics more effective, we are assembling materials on techniques and 
methods that you are using in other countries. We welcome most hearti¬ 
ly this opportunity to consult with you about them. I assure you that 
we will make every effort to place our data and our studies at your dis¬ 
posal and to conform to international standards for widely used statistical 
data, so that between your'work and ours there will be an ever widening 
area of comparability and of understanding. 


Resume 

Le Bureau des Statistiques du Travail des Etats-Unis est un des prin- 
cipaux offices federaux de reunion et d’analyse de statistiques 6cono- 
miques courantes. Ses activites se repartissent actuellement sur deux 
importantes sections: la prompte publication de statistiques concernant 
des aspects importants de Teconomie americaine, tels que Temploi et les 
salaires industriels, les prix et le cout de la vie, les gains des salaries, les 
accidents de travail et les conflits de travail. En outre, le Bureau s’oc- 
cupe d’analyses economiques servant de base numerique h la politique 
du travail. 

II faut remarquer qu’il n’y a pas d’obligation legale de fournir des 
donnees au Bureau. Toutes les donnees sont obtehues par collaboration 
volontaire. 

Apekcu histobique 

Le “Bureau du-Travail” a et6 etabli en 1885 comme une division du 
Departement de ITnterieur. Lorsque ie 4 mars 1913 un D6partement 
du Travail fut cree, le Bureau des Statistiques du Travail, comptant 
d6j4 28 annees d’existence, devint une division du nouveau Departement, 
ce qu’il est encore toujours. 

Les dix premiers rapports annuels, publics entre 1886 et 1895, traitent 
les mati^res suivantes: crises industrielles, travail de prisonniers, grfeves 
et lockouts; fer, acier, houille, textiles et verre; ensejgnemeniprofessionnel; 
associations de construction et de pret. La premiere grande enquete 
sur les depenses des families de salaries a dej4 6t6 faite en 1901; les pre¬ 
mieres etudes sur la productivity du travail datent de plus de 50 ans. 

A la longue, Texp^rience a appris qu’il etait nycessaire de rygulariser 
certaines statistiques fondamentales et que des series statistiques' continu¬ 
es devaient etre 6tablies et publiyes ryguliferement. Pwr example, la 
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premiere aerie concernant remploi dans Tindustrie a 6te publi6e & 
partir de 1923; les series de prix de gros ont 6t6 commenc6es en 1902 
(remont^es, par la suite, jusqu’4 1749); le premier nombre indice du 
co6t de la vie a 6te publi6 en 1921, et, plus tard, remont6 jusqu’A 1913. 


Programme de travail actuel 

La t&che principale, A present, est d’assurer la regularity des nom- 
breuses s6ries statistiques pyriodiques qui ont 6te developpyes par 
le Bureau, Elies ont yte classifiees suivant les six groupes principaux 
ci-apr^s: 

1. Emploi et salaires, 

2. Mutations de. personnel dans les industries manufacturiferes, 

3. Heures de travail et salaires hebdomadaires et horaires, 

4. Prix et coOt de la vie, 

6. Conflits de travail dans Tindustrie americaine et nombre de jours- 
ouvriers perdus qu’ils ont cause, 

6. B&timent et construction. 

En outre, le Bureau continue de s’occuper de nombreiises etudes d*- 
ordre trAs vari6 se rapportant A plusiours phases du march6 du travail 
et de Tindustrie americaine, et de problAmes internationaux du travail 
en tant qu’ils sont H^s A des questions domestiques. 

Programme technique 

Un des probiemes les plus importants en statistique est le moyen 
d*obtenir des informations sures sur lesquelles on puisse baser des 
r6sultat8 statistiques. Nous nous effor 9 ons d’ameiiorer constamment et 
d’augmenter Tefficience des donnees de base utilisees. Les discussions 
techniques aux Conferences Internationales de Statistique ont concerne en 
premier lieu les probl^mes d’ychantillonnage. Au cours des derniAres 
^x annAes, de grands pro^As ont ete rAalisAs dans notre connaissance 
dans ce domaine. Les statisticiens du Bureau des Statistiques du Travail 
ont contribuA A ces d^veloppements et utilisent les meilleures methodes 
d’echantillonnage connues. 

Une partie importante de notre programme technique actuel est de 
prAparer des manuels dAcrivant les procAdures statistiques utilisAes pour 
le calcul de nos divers indices. Dans un avenir prochain, nous espArons 
avoir une sArie complAte de tels manuels. Malheureusement, les travaux 
techniques du Bureau, de mAme que ceux d’autres services, ne sont 
pas assez connus. Je considAre comme un de mes principaux devoirs 
de mettre A la disposition des statisticiens, tant aux Etats-Unis que 
dans d’autres pays, les contributions mAthodolc^iques du Bureau des 
Statistiques du Travail, 



THE AGRICULTURAL STATISTICS PROGRAM 

by Charles F. Sarle 
Bureau of Agricultural Economics 
{United States) 

Perspective 

The more commercialized the agriculture of a country, the greater 
the demand for current statistics concerning all aspects of agriculture. 
Where agricultural products are grown only for farm and local consump¬ 
tion, there is little demand for agricultural statistics other than perhaps 
for an occasional agricultural census. The evolution of the demand 
for agricultural statistics has been well exemplified historically in the 
United States. 

The publication of statistics on crops, livestbek, and prices of agri¬ 
cultural products is the oldest activity in the Department of Agricul¬ 
ture, having been started in 1862 when the Department was organized. 
These statistics were begun after several decades of agitation by leading 
farmers for unbiased agricultural statistics concerning condition during 
the growing season, and harvested production of crops that were being 
produced commercially, especially cotton, wheat, and other grains. 
These farmers wanted to be protected, as they said, from the effect of 
false and misleading reports emanating from those who wished to 
buy their products at low prices. 

As a nation’s economy becomes more diversified and complex, demand 
for agricultural statistics increases. Demand is not only for broader 
coverage of agriculture, but also for other facts relating to the ever 
changing agricultural process, for statistics at more. frequent intervals, 
and for greater accuracy. This demand is accelerated by the strain 
put upon a nation’s economy by war. When national economies are 
subjected to wo rid-wide depression and governments embark on pro¬ 
duction control and price-support programs, the demand for more 
and better agricultural statistics increases almost overnight. 

Kinds of Agricultural Statistics . 

At present, the demand for agricultural statistics, which the Depart¬ 
ment’s program endeavors to meet with the resourcei? available, covers 
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a broad field. In addition to statistics concerning production, prices, 
marketing, farm employment, and wage rates, the Bureau of Agricultur¬ 
al Economics maintains such regularly recurring statistical series or esti¬ 
mates as ‘Indices of farm production; farmers’ cash receipts and expendi¬ 
tures; parity prices and parity income; gross and net farm income; esti¬ 
mates of per capita food consumption for individual commodities; changes 
in land values and volume of sales of farm real estate; farm taxes and 
and tax returns; interest paid and indebtedness; valuation of livestock 
and farm equipment; cost and returns for specific types of farming; es¬ 
timates of farm population; migration to and from the farm; and similar 
series which are prepared by bringing together and studying large masses 
of data collected by this Bureau and other agencies. 

To meet these needs, the Bureau of Agricultural Economics published 
numerous basic statistical series throughout the year. Included are 
series of current estimates of production, stocks and prices of over 150 
farm products, and also farm wages and employment. (See Appendix 
A—“Agricultural Statistical Series Published by the Bureau of Agri¬ 
cultural Economics”) 


Oboanization and Coopebation 

The Bureau of Agricultural Economics is general overseer of the 
economic research and statistics program of the Department of Agri¬ 
culture. Six divisions of the Bureau are engaged primarily in gather¬ 
ing crop and livestock statistics. These divisions are known collective¬ 
ly as Agricultural Estimates. There are six other divisions of the 
Bureau—the economic investigations divisions—which also construct 
and maintain regularly recurring statistical series, such as farm income 
and expenses, marketing margins, farm population, mortgage debt, land 
values, taxes, etc. 

The Bureau maintains 41 State statistical oflSces which serve all 
States. The state agricultural statisticians in these offices are respon¬ 
sible for maintaining cooperative relations with State agencies and con¬ 
tact with farmers and other people for collecting statistical data relating 
to agriculture for their respective States; and for analyzing, summariz¬ 
ing and interpreting the information received from farmers and other 
sources which they forward to the Crop Reporting Board or to statis¬ 
tical divisions in Washington for review and assembly into State and 
national averages and totals. 

Appendix B is a chart that shows diagrammatically the Bureau’s 
nation-wide fact-finding organization, and how farm statistics are collect¬ 
ed and distributed to the people who use them. 
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Sources of Data for Current Agricultural Statistics 

The data used in making agricultural estimates fall into five general 
categories: 

(1) Enumeration Data: Data that are obtained by complete or 
nearly complete enumeration, such as the periodic agricultural censuses 
which have been taken every 5 years since 1920, and at 10-year inter¬ 
vals from 1840 to 1920; annual enumeration of crop acreages made 
by local tax assessors in about 12 States; and statistics covering the 
operations of various types of processors and handlers of commercial 
agricultural products, such as cotton ginnings, rice millings, peanut 
shellings, tobacco sales, sugar manufactured from sugarcane and sugar 
beets, vegetable processors, carlot shipments of fruits and vegetables, 
plant production of manufactured dairy products, shipments of live¬ 
stock and grain, market receipts and quantities of certain agricultural 
products processed for sale. In some 31 States tax authorities report 
annually or biennially on the assessed numbers of live stock on farms. 

(2) Mailed Sample Data: Questionnaires are distributed in two 
ways. Either they are mailed directly to lists of volunteer reporters 
who serve without pay or are distributed by rural mail carriers to about 
10 percent of the farms along their routes. The rural-carrier surveys, 
conducted in cooperation with the Post Office Department, are made 
once a year (October) to obtain information on crop acreages harvested, 
and twice a year (June and December) to collect information on live¬ 
stock numbers and production of livestock. 

In addition, the 41 field offices maintain a number of special lists of 
volunteer reporters to whom various types of mailed inquiries are sent, 
such as prices received by farmers, prices paid by farmers, special com¬ 
mercial crops, milk producers, feeders of cattle, sheep, and lambs, 
acreage planted, acreage harvested, and production of crops, etc. A 
mailed sample also is used to obtain information from flour mills and 
grain elevators, cotton ginners, local slaughterers of livestock, creamer¬ 
ies, fluid milk plants, hatcheries, and other processors of ag^-icultural 
products. 

The inquiries sent to the list of volunteer reporters include questions 
concerning crops, livestock, farm wages, etc. in their respective locali¬ 
ties and also questions concerning acreage and production of crops and 
livestock on their individual farms. The rural-carrier surveys always 
relate to the individual farms of the respondents. 

During the entire year a total of about of 9,500 separate schedules 
are mailed to lists of farmers and others including those distributed 
the rur^l carriers. In all a total of approximately 9,800,000 
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schedules are distributed in this manner and about 2,600,000 or 26 
percent are returned and tabulated. 

The regular list of 80,000 volunteer farmer reporters receive a sche¬ 
dule the first of each month. Of this number about 24,000 schedules 
or 30 percent are returned and tabulated. The rural carriers distri¬ 
bute about 600,000 cards to farmers along their routes three times each 
year. About 160,000 cards or 27 percent are returned and tabulated. 
In June a mailed survey on crop acreages is sent to lists of about 344,000 
volunteer reporters. Of this number about 75,000 schedules or 22 
percent are returned and tabulated. In late October a mailed survey 
on crop acreages harvested, acres abandoned during the growing season 
and production are sent to about 320,000 volunteer reporters. About 
88,000 schedules or 27 percent are returned and tabulated. 

(3) Field Observation and Contacts: Information concerning crops 
and livestock is obtained by general field observation and personal 
contact with well-informed growers and other “key” people who buy 
or handle farm products. This approach is practically indispensable, 
for example, in making estimates of fruit and vegetable crops, the 
production of which in most areas is highly localized because of special 
requirements of soil, climate, and markets; in evaluating the damage 
done to crops by such disasters as hurricanes, droughts, freezes, floods, 
or hailstorms, and in estimating cattle and sheep on feed. 

(4) Objective Plant Counts and Measurements: With certain impor¬ 
tant commercial and feed crops, objective plant counts and measurements 
are made in the fields in which these crops are growing. For example, 
just before harvest, yield per acre of small grains, corn, or soybeans 
can be estimated by taking small samples of specified areas from fields 
throughout the territory where the crop is grown. Objective methods 
are used in selecting the fields to be sampled and in selecting the small 
“sample areas” for harvest. 

The percentage of infestation of boll weevil in cotton is measured 
by counting the sound and infested bolls. For citrus fruits “frame 
counts” are made in California and Florida in selected groves to deter¬ 
mine the number of fruits on trees in comparison with previous years. 
Diameters of representative fruits also are measured to obtain an index of 
size. Estimates based on objective plant-count measurements are free from 
the bias of personal judgment of the observer or opinion of the reporter. 

Another objective field measurement of crop acreages is obtained by 
a machine called the crop meter. This machine, which is attached to the 
speedometer cable of an automobile, is used to measure the frontage 
of each kind of crop along selected routes each year. 

(5) . Preselected Interview Surveys: In recent years sample inter¬ 
view surveys have been successfully used tq a limited extent in making 
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estimates of certain kinds of agricultural phenomena, such as family 
and hired labour employed on farms and farm wage rates, farm income 
and expenses, inventories of livestock, crops, and farm machinary, etc. 

Many kinds of important agricultural data are difficult or impossible 
to secure by mail and these must be obtained by enumeration or inter¬ 
view. The interview survey method makes it possible to reach all 
types of farms and farmers, including people who do not respond to 
mailed questionnaires. It is less expensive and time-eonsuming than 
a complete census. 

In an interview survey, well-trained rural people are employed to 
interview all farmers (or others) in small areas of about five farms each 
selected beforehand on a representative basis. The ehief thing is that 
a small but carefully selected cross-section sample of the population 
of farms or of farm operators is contacted and that the desired informa¬ 
tion is obtained by personal interview. 

Statistics obtained in this way can be expanded into estimates for 
a small area within a State, for an entire State, for a group of States, or 
for the nation as a whole, depending upon how many farmers are inter¬ 
viewed and how great an area is covered. 

If national totals only are desired, the number of farms in the sample 
may be quite small for certain items. But to get accurate estimates 
for regions, States, or areas within States, proportionately larger 
samples are necessary. Thus, if State estimates are desired, almost 
as many interviews may be necessary within each State as would be 
required throughout the entire country for corresponding national es¬ 
timates. The accuracy of an estimated average or total depends on the 
number of observations included in the sample as well as on the frequ¬ 
ency of occurrence and degree of variability of these observations. 

The number of interviews necessary depends also on the type of in¬ 
formation or estimates desired. For instance, it takes a comparatively 
small sample to provide dependable data for items or conditions com¬ 
mon to a large proportion of farms—say, the number of farms raising 
livestock or producing corn. But a comparatively large sample 
must be surveyed to get accurate statistics about something common 
to only a small proportion of farms, such as specialized equipment like 
combines or corn pickers, or the number of hired farm laborers. 


Methods of Estimation 

It is an oversimplification to say that the 5-year periodic census 
statisics are used as “bench marks” for current agricultural statistics 
and that the other data mentioned above are used only to provide a 
basis for estimates iu intercensal years. Actually, the statistica series 
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published by the Bureau for Agricultural Economics are in a large part 
estimates based on the relationships (regressions) that exist historically 
between mailed sample data and various presumably complete or nearly 
complete enumeration data including the Federal census, State asses¬ 
sors’ censuses in those States where they are available, and/or various 
commercial check data mentioned under class 1 source of data. 

One example of agricultural statistics entirely independent of census 
enumerations is agricultural prices. In fact, the price data collected 
monthly by the Bureau of Agricultural Economics during a census 
year are used by the Census Bureau in arriving at the value of agricul¬ 
tural products. The price statistics of the Bureau of Agricultural Eco¬ 
nomics—prices received and prices paid by farmers—are based almost 
entirely on mailed samples from special volunteer price reporters who 
are usually local dealers and merchants in farm communities through¬ 
out the country. 

The Bureau of Agricultural Economics of the Department of Agri¬ 
culture is responsible for the current series of statistics relating to agri¬ 
culture. The series relating to agricultural production for the United 
States and for each of the 48 States—intentions to produce, prospective 
production, and estimates of production as well as prices received and 
paid by farmers—must be timely to be of value. For example, the 
monthly crop reports relating to conditions as of the first of the month 
are issued between the 8bh and the 10th of the current month, the twice- 
a-year reports of hog production (The Pig Crop Report) are issued within 
18 to 20 days of the end of the 6-month period covered by the report. 
Somewhat more time (about 6 weeks) is allowed for the December re¬ 
port of harvested acreage and production of all crops. The public has 
been used to this kind of a “ timetable ” since about 1865, or for more 
than 80 years. Any attempt to extend the time by even a few days 
would be highly unpopular. Consequently the planning of future deve¬ 
lopments and improved sampling techniques will need to keep this 
speedy timetable in mind. 

The Bureau of the Census is responsible for the agricultural census 
which is taken every 5 years. The census statistics provide information 
in great geographic detail, that is, by counties, but there is necessarily 
a considerable time lag in the release of census statistics. 


Statistics on General or Major Crops 

The general crop statistics fall into two categories: (a) Estimates of 
acreage harvested, yield per acre and production; and (b) estimates of 
acreage planted, condition of the growing crop, and prospective produc¬ 
tion. 
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The Federal census and State assessors’ censuses in many of the im¬ 
portant North Central States, along with the annual (October) mailed 
rural carrier survey, provide a reasonably dependable basis for esti¬ 
mates of harvested acreages of the more important grain and feed crops. 
Cotton ginnings provide an annual check on cotton production. The 
mailed returns from volunteer crop respondents who report on average 
yields per acre for different crops in their locality, usually provide a de¬ 
pendable basis for State estimates for yield per acre for major crops. 

The monthly condition of growing crops reported in “percent of a 
normal or full crop,” when interpreted on the basis of average relation¬ 
ship (regression) for that month and crop between reported condition 
and final yield per acre, usually provides a reliable indication, as of that 
date, of the prospective out-turn per acre for most major crops. 

The closer the date of the reported condition to the time when the 
crop has reached maturity, the higher the relationship between condi¬ 
tion and final yield, and hence the more reliable is the indication of pro¬ 
spective yield per acre. The earlier in the growing season that condi¬ 
tion is reported, the greater the possibility that subsequent weather 
can materially modify these early indications of yield per acre. 

The reported condition of a growing crop fails to be a dependable in¬ 
dication of prospective out-turn with some crops in certaih areas even 
late in the season. With some crops, the report of the “probable yield 
per acre” used on a relative basis from year to year is a bettor indication 
of harvested yield than the condition, as the latter tends to reflect only 
the vegetative appearance of the growing crop. 

Limitations of Source Data 

Census statistics available every 5 years are most reliable on acreage, 
yield, and production of major general crops. However, even the cen¬ 
sus statistics on these crops are subject to some error because the owner 
or tenant-operator on the farm when the census is taken is not always 
the same person who operated that farm the previous crop season. If 
the census could be taken in the late fall, this source of error would be 
held to a minimum. 

The census statistics of the production of fruit crops in census years, 
along with some annual check data on the commercial movement of 
fruit crops and the reported condition of these crops in percentage of 
normal or “full crop,” provide a reasonably satisfactory basis for esti¬ 
mates of the production of the major fruit crops in most States. 

Vegetable and Special Commercial Crop Statistics: 

It is with vegetable statistics that census enumeration data are most 
incomplete and inaccurate. For example, the 1945 census schedule 
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included only nine of the 29 vegetable crops for which the Bureau of Agri¬ 
cultural Economics makes official estimates. It has not been possible 
in the past to so select, train, and supervise census enumerators that 
they will consistently ask all the questions on the schedule relating to 
crops and other agricultural items that occur on only a small percentage 
of the farms in their respective enumeration districts. 

It is extremely difficult also to obtain reliable information concerning 
these sporadic phenomena by means of the mailed questionnaire to lists 
of volunteer correspondents. When the production of a vegetable or 
other special crop is highly localized geographically because of exacting 
soil, climate, or market requirements, the most economical method of 
obtaining information concerning acreage and production is by personal 
contact with well-informed growers and other “key” people who buy 
or handle such crops. The other and more expensive alternative is either 
a complete enumeration of all the producers in each local producing 
area or an interview sample of a large proportion of these growers. 

Livestock Statistics: 

If the censu§ could be taken at the same time of year each time and 
taken during a short period, the census livestock statistics of numbers 
of different kinds of livestock on farms would provide a much more satis¬ 
factory basis for annual inventory statistics. Census statistics of the 
production of livestock and livestock products during the preceding year 
are in considerable error (memory bias) because of the seasonal nature 
of such production. The same difficulty exists with any agricultural 
phenomena with high within-season variation, such as farm family and 
hired labor, farm expenses and income, etc. 

Census data on milk production covering an entire calendar year are 
subject to considerable bias as they tend to be influenced by the level of 
production at the time of year when the census is taken. For example, 
if the census is taken in January—a period of low production in most 
areas—^milk production for the previous year will be greatly understated 
to the enumerator. A measure of the seasonal pattern of milk produc¬ 
tion per cow is obtained from the monthly reports of regular crop report¬ 
ers and from the June and December returns from the rural mail 
carriers. 

Statistics of manufactured dairy products include a complete enumera¬ 
tion of the plant output of the major products, together with current 
estimates on a monthly or weekly basis for the more important ones. 
Each year a complete enumeration of factory output of about 45 dif¬ 
ferent kinds of dairy products is obtained. Dairy plants keep compa¬ 
ratively accurate records of production anid in many States collection 
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di data is assisted by State laws requiring the firms to report the amounts 
.manufactured. In 28 of these States the ^Bureau has entered into co¬ 
operative agreements with certain State agencies to provide for the joint 
collection of these reports. These facts, plus a diligent f511ow-up pro¬ 
gram in obtaining reports for delinquent plants, have resulted in statis¬ 
tics that closely approach 100 percent completeness on all but a few 
minor items. 

Poultry and egg production statistics also have high intraseasonal 
variability. Consequently, the census taken at only one time during 
the year does not provide reliable data on numbers of chickens produced 
or sold or eggs produced. However, the mailed sample taken monthly 
does provide a useful measure of the seasonal pattern of poultry and 
egg production. 

Farm Employment and Wage Rates: 

The Bureau of Agricultural Economics series on farm employment, 
family and hired labor (monthly), and farm wage rates (quarterly) are 
based on a mailed inquiry to the regular volunteer reporters of the Bu¬ 
reau. The sample returns on farm employment are adjusted during 
the season by factors derived from a comprehensive study of census data 
and farm labor requirements obtained from farm-management inves¬ 
tigations made in different parts of the country. During the last few 
years; five nation-wide interview and several special mailed surveys 
have been made on farm employment and wages. It was found that 
on the national level there was very little difference between the wage 
rates obtained by the interview sample and the mailed sample. 

An analysis is now being made of data on farm employment and wages 
obtained by the two methods of sampling for the purpose of determining 
more satisfactory within-scason adjustment factors for use with the 
mailed sample, pending the time when resources will x)ermit a quarterjiy 
interview survey of farm employment. Farm employment varies greatly 
with the seasons of the year, and the farms of crop reporters who report 
monthly are not sufficiently representative to provide a sample that 
can be used without seasonal adjustments. 

Mailed versus Preselected Interview Sampuno 

The mailed sample has several outstanding advantages and some se- 
rious shortcomings as compared with the preselected interview sample 
of a representative cross-section of farms. The mailed sample is inex¬ 
pensive both in time and money, and the returns can be obtained within 
a few days through the 41 field offices of the Bureau. 

When the results of mailed samples are used on a regression basis 
with a reliable series of census, assessors, and/or commercial check data, 
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useful State and national estimates can be made for major crops and 
classes of livestock in most States. 

On the other hand, the mailed sample has serious limitations. As it 
is not a representative cross-section sample, only statistical averages and 
ratios can be used from it. These, in turn, must ordinarily be used on 
a regression or relative basis in making estimates. However, mailed 
samples on prices are an exception to this generalizatiotn. Other highly 
useful statistics, such as frequency distributions, frequencies of occur¬ 
rence, and totals cannot be derived satisfactorily from the mailed sample. 
Selectivity of Mailed Samples: 

In using the mailed sample it is recognized that it is selective and not 
fully representative of the population for which it is drawn. It is selec¬ 
tive at two levels: 

(1) The usual mailing list to whom mailed questionnaires are ordi¬ 
narily sent is not a representative cross-section of the population of farm 
operators, unless it has been recently drawn from a complete census or 
is a list of operators obtained by a preselected interview sample survey. 

(2) The response obtained by mail is never 100 percent complete, 
hence there may be selectivity in the responses that are obtained. The 
differential response of a mailed sample may vary greatly because of 
the effect of many unknown psychological, social, and economic factors 
over which the statistician has little or no control. The differential 
response is especially serious in sampling agricultural phenomena that 
occur on a relatively small proportion of farms. Experience has shown 
that a mailed questionnaire designed to obtain such information has 
better “drawing power” when a number of questions are added that 
relate to other phenomena that occur on practically all farms. 

The differential response to a mailed inquiry is not necessarily cons¬ 
tant from one season of the year to another, or from season to season, 
or from area to area, as these little understood psychological, social, and 
economic factors change in time. For example, a different response 
would be expected on a cotton acreage inquiry when the price of cotton 
has dropped sharply than when the price has remained fairly constant 
over a period of a year or two. Part of the changing selectivity of the 
returns from the mailed sample is caused by varying proportions of 
“in and out” producers of an agricultural product from season to 
season. 

Considerable research and experimenting needs to be done with mailed 
sampling when a true cross-section sample of farm operators is used as 
a list to whom the mailed inquiries are sent. Using such a list eliminates 
the first cause or level of selectivity with mailed samples as they are now 
generally used by the Bureau. Such lists could be drawn from the tax 
assessors’ annual census records in the States where they are available. 
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The respondents of an annual preselected interview sample also would 
furnish such a list. 

The research should be directed toward the discovery of psychological, 
social, and economic factors that give rise to the differential response to 
mailed inquiries of different kinds. To the extent that these factors can 
be determined, ‘‘control items” could be included in the original inter¬ 
view schedule for use in stratifying and weighting the returns of subse- 
quent mailed samples, thereby minimizing selectivity at the second level 
mentioned above. 

The effect of repeated “follow-up” of the same schedule to the persons 
who fail to respond on the first request needs further investigation and 
may lead to the development of a basic theory of nonresponse that can 
be expressed mathematically and ultimately used in estimating for the 
farms of nonrespondents. The Bureau statisticians have other ideas 
along these lines that should be tested. Every effort should be put forth 
to combine the advantages of interview and mailed samples in order to 
maximize accuracy and speed in getting sample data at minimum cost. 

Future Needs for Agricultural Statistics 

The basic long-run objectives of the agricultural statistics program of 
the Bureau of Agricultural Economics arc threefold. They may be 
summarized as follows: 

(1) Statistical: To improve the accuracy of the official agricultural 
statistics of the Bureau and to develop additional essential statistics 
concerning agriculture that are needed in our complex industrialized 
national economy. 

(2) Research: To provide agricultural research economists and rural 

sociologists with representative observational data from a true 
cross-section sample of farms, farm operators, and farm people, or of 
specified subpopulations thereof, which would serve as a valid basis for 
testing provisional and alternative economic and social hypotheses con¬ 
cerning the behavior of agricultural phenomena, including farm people 
themselves. ^ 

(3) Federal-State Cooperation: To develop in each State a sound 
integrated cooperative sampling program for providing State interests 
with agricultural information needed at the State level, and to provide 
State economists and rural sociologists with representative observa¬ 
tional data for research purposes. 

The basic requirements of an agricultural statistics program to meet 
the above objectives include: 

(1) One large annual nation-wide interview sample: This sample should 
Ve of sufficient size to provide reliable State estimates for about 
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three-fourths of the States—^the larger States in terms of number of farms 
—and for groups of smaller States. The State estimates from this sam¬ 
ple would be limited primarily to agricultural items that occur on about 
26 percent or more of the farms in a State or in a group of small States. 
However, national and regional estimates could be made for agricultural 
items that occur on a smaller proportion of farms. The minimum size of 
the annual nation-wide sample to meet these objectives would be about 
60,000 farms, with the sample distributed in about 2,400 counties. 
Eventually this sample should be increased to 100,000—120,000 farms 
distributed in all agricultural counties. 

It would be necessary to establish a current list of the large commer¬ 
cial farms and use a higher sampling rate with these. 

West of the hundredth meridian (in the far western and Pacific Coast 
States) it would be necessary to establish and maintain currently a list 
of the larger cattle and sheep growers who use public grazing lands for 
their herds and flocks, and to delineate the irrigated and^dry-land farming 
areas on appropriate maps in order that the sample segments may be 
drawn predominately from these strictly agricultural areas. Delinea¬ 
tion of nonfarming, cut-over, and forest lands would also make it possible 
to increase materially the efficiency of area sampling in many other 
States, such as Michigan, Wisconsin, and Minnesota, and some of the 
Appalachian, Atlantic Coast, and Gulf Coast States. 

(2) Three quarterly interview surveys a year: If more accurate statis- 
tics of agricultural phenomena that have a high within-season variability 
are to be obtained, interview surveys must be made oftener than once 
a year. These phenomena with high intraseasonal variation include 
family and hired labor, wages, production of milk, eggs, and livestock, 
the incidence of accidents and sickness to the farm population, and farm 
income and expenses. The frequency of occurrence of many of these 
items during a 3-month period is usually relatively low. A longer period 
than 3 months is too long for detailed and accurate memory by most 
farmers and would result in considerable “memory bias.’* 

These quarterly surveys should probably be made in January, April, 
and July. 

.(3) Special mailed samples to the respondents of the annual interview 
sample: Special mailed samples to such a cross-section list of respon¬ 
dents would provide a much better basis of sampling than is now in use 
by the Bureau in making a number of its more important agricultural 
surveys each year. For example, if the annual interview sample were 
made in October or November, a mailed sample to these respondents 
could be made: 

(a) In June each year, on hogs and milk cows, and on crop acreages 
planted, eventually to replace tbe June ruTAl-cj^-rrier livestock survey 
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and the June acreage survey to voluntary correspondents. These two 
surveys are among the more important ones made during the entire 
season. 

(b) In January on numbers and kinds of livestock on farms on Ja¬ 
nuary 1 as a basis for the annual estimates of livestock inventories. The 
October inventories would be brought up to January 1. 

(c) In April to the respondents of the annual survey in the 12 North 
Central States to serve as a basis for a preliminary estimate, of the size 
of the spring pig crop. There is an insistent demand on the part of the 
livestock industry for such statistics. 

(d) In December on hogs and the fall pig crop, eventually to replace 
the December rural-carrier livestock survey. 

(e) In March on acreage planting intentions. The returns would 
be compared directly with the crop acres harvested the previous fall 
which are obtained on the annual interview survey. 

(4) ""Flash"' surveys: There is keen interest in a sampling scheme 
that would get quick results from a small sample on what farmers are 
thinking and planning to do when they are subjected to the impact of 
forces (economic, weather, and economic-political) which are beyond 
their control. It is likely that surveys of this kind might be directed 
to specific segments of the farm population, such as cattle or lamb feed¬ 
ers, commercial hog or dairy products, or producers of special commer¬ 
cial crops, such as citrus or potatoes. For example, such surveys might 
be used to discover farmers’ reactions to a proposed control-price support 
program with a specific agricultural commodity. 

A large annual interview survey of 120,000 farm operators would 
provide an excellent basis for small but representative subsamples of 
operators falling into these special categories. Representatives of the 
Bureau’s 41 field offices, with some help in the form of interviewers, 
could handle one of these small surveys of 1,000 to 3,000 farms rather 
quickly. 

(5) Vegetable and fruit croj)S statistics: The statistics that have 
the poorest foundation of census and other enumeration data and some 
of the most difficult problems of sampling and estimation are those re¬ 
lating to vegetable, fruit, and specialty crops. If this problem is to be 
solved, it will be necessary to establish and maintain current lists of com¬ 
mercial producers of vegetables, fruit, and specialty crops, State by State, 
which, could then be sampled by mail and interview methods either 
singly or in combination, to provide a sound statistical basis for the 
statistics of acreage, production, and marketings of such crops. 

In the case of tree fruits, complete enumerations are needed every 
6 or 8 years in all chief commercial producing areas to obtain informa¬ 
tion concerning the kind^ age, variety, and production of tree fruits. Such 
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a census is necessary as a starting point for subsequent sampling and 
subsampling. 

(6) Special small nation-wide interview economic surveys: If fully 
reliable statistical series are to be developed and maintained on a national 
and regional basis for such economic items as gross and net farm income, 
farm expenditures, nonfarm family income, indebtedness, savings, etc., 
it will be necessary to make special small nation-wide interview surveys, 
utilizing highly qualified interviewers who have had adequate training 
in the application of sound, practical social-psychological principles 
to the interview situation. These interviewers must be carefully super¬ 
vised. In fact, considerable research and experimentation is needed 
to determine the best methods for minimizing what might be called 
“income tax bias’* that is so prevalent in the reports of farm income. 
It will be some time in the future before these methods are sufficiently 
developed to justify a nation-wide sample of sufficient size to provide 
useful State estimates on farm income. 

Conclusion: It is our conviction that a successful program of interview 
sampling must have three essential attributes. These attributes are like 
the three legs of a stool or table. Each must be strong and dependable or 
the stool is useless. These three attributes are: 

(a) Statistically sound and efficient sample design 

(b) . Psychologically sound and practicable schedule design and 
interviewing methods 

(c) Practicable and efficient organization and operation in the Wash¬ 
ington office and the 41 field offices of the Bureau, emphasizing parti¬ 
cularly the most effective practices of selecting, training, and super¬ 
vising interviewers. 


Appendix A 

Agricultural Statistical Series Published by the Bureau op 
Agricultural Economics 

As the farmers’ principal economic fact-finding and research agency, 
the Bureau of Agricultural Economics publishes many statistical series 
about farm products, farm people, and many phases of farm business. 
Primary StcUistics: 

The types of agricultural statistical series that are obtained by sam¬ 
pling are summarized below. All of these series are for the United 
States (excluding possessions) and most of them also are by States. 

(1) Crop acreages (108 crops) 

(2) Conditions of crops and pasture; prospective and harvested 
yields per acre and production (136 crops) 
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(3) Stocks of products on and oif farms 

(4) Numbers of livestock and poultry on farms; livestock feeding 

operations; livestock raised; volume of dairy, poultry, and 
livestock products 

(5) Crop planting and livestock-breeding intentions 

(6) Farm disposition of crops and livestock 

(7) Processors ’ operations 

(8) Prices received and paid by farmers 

(9) Farm wage rates 

(10) Farm employment 

(11) Interest and tax payments 

(12) Farm machinery information 

(13) Land values 

(14) Farm population and movement to and from farms 

Statistics Computed from Primary Series: 

To make these primary data easier to interpret and use, various kinds 
of series have been developed which might be described as statistical 
measuring-sticks. 

These include the widely used index numbers of prices paid and re¬ 
ceived by farmers, of farm real estate values, volume of production, and 
farm output. They also include parity prices and livestock-feed price 
ratios. These measuring sticks, computed on the same basis for a period 
of time, show in brief form the gist of the meaning in many different 
groups of statistical series. 

For instance the index of prices paid by farmers shows in one figure 
the present level of prices compared with a base period for 180 different 
commodities bought by farmers, plus interest and taxes. The index 
of prices received by farmers shows in one figure the present level of 
prices received for 165 commodities produced and sold by farmers also 
compared with a base period. When the index of prices received is 
divided by the index of prices paid, the resulting single figure, known as 
the parity ratio, shows how much farmers’ products are worth in terms 
of purchasing power. 

The types of statistics which are computed from the different pri¬ 
mary groups described above are summarized in the following list. For 
some of these groups listed below, the primary statistics are combined 
with data from fact-finding agencies outside the Bureau to compute 
the series required. 

(1) Supply and disposition of agricultural products 

(2) Cash receipts and gross farm income, farm production expenses, 

and net farm income 

(3) Financial condition of agriculture 
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(4) Retail value, farm value, and marketing margins of food 
products produced by farmers 

(5) Total and per capita consumption of food products produced 

by farmers 

(6) Feed supplies per animal unit 

(7) Consumption of feeds tuffs by various classes of livestock 

Statistics about Farm Business and Farm People: 

Although the above-listed statistical series cover a wide range of 
agricultural information there is demand from many sources for more 
statistics about farm business and farm people and for greater accuracy 
in the existing statistical series in this field. Steps are already being 
taken, insofar as resources permit, to collect more factual information 
by interview sampling and otherwise to serve as a basis for establishing 
new statistical series and for strengthening the Bureau's present series 
for wider use. The list which follows shows the subjects on which in¬ 
formation, now inadequate or completely lacking, is most needed. 

(1) Farm labor and farm wages 

(2) Farm population and migration to and from farms 

(3) Accidents on farms 

(4) Sickness of farm people and medical and hospital facilities 

(5) Farm home facilities 

(6) Farm family living expenditures 

(7) Farm production expenses 

(8) Income from the sale of farm products 

(9) Family income from sources other than farming 

(10) Inventories of farm equipment, livestock, and crop stocks 

(11) Net farm income ^ 

• (12) Farm indebtedness, credit, and interest rates 

(13) Land utilization 

(14) Land ownership and tenure 

(15) Land values and rents 

(16) Values of farm buildings, new construction, and repairs 

(17) Changes in farm management practices 

(18) Methods and costs of marketing 

(19.) Farmers’ marketing intentions 

(20)* Consumer preferences 

The Bureau’s statistical series showing changes in the farm business 
are not as complete as its statistics about farm products. As much of 
the basic information is obtained only once in the 6 or 10 years by the 
Bureau of the Census, many of these series* are more valuable as his¬ 
torical data than for current use. Furthermore, the Bureau of Agricul¬ 
tural Economics has had to depend very heavily upon data from other 
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f'ederal, State, or private agencies. Much of this information, although 
adequate for special purposes for which it is collected, is difficult to use 
in the Bureau’s official statistical series, especially those computed form 
primary series, which must be dependable and up-to-date, and must 
be maintained in a form which can be used for many purposes. 


Appendix B 



The Bureau’s limited staff of professional economists working in the 
field on cooperative projects with Land-Grant Colleges has collected 
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a great deal of farm business data, but the information has been collected, 
from farms representing a specific area and for the purpose of analyz¬ 
ing the special farming problems of that area. It is therefore diffi¬ 
cult to combine this information into estimates for larger areas. The 
Bureau^s research staff is now undertaking to develop farm management 
data that will show annual changes in systems of farming in income, 
expenses, and net income by types and sizes of forms for the more im¬ 
portant farming areas. For this kind of statistical series, sample surveys 
are needed to provide data from representative farms on a comparable 
basis by areas, types of farms, and periods of time. 


R^sum^ 

Les premieres statistiques agricoles publi6es par le D6partement 
de rAgriculture des Etats-Unis vers 160, fournissent des donnees sur 
r^tat des recoltes et des estimation sur leur rendement. Ces statistiques 
ont 6t6 publi6es pour r6pondre k la demande d’agricultures d’obtenir 
des informations propres k redresser les renseignements souvent faux ou 
errones communiques par les n^gociants de produits agricoles. Le 
domaine des statistiques agricoles s’est etendu au point qu’^ peu pr^s 
toutes les phases de la culture et de Televage, ainsi que les prix re 9 us et 
payees per les agriculteurs et le march6 du travail agricole sont main- 
tenant compris dans les series statistiques periodiques ou occasionnelles 
publi^es par le Bureau d’Economie agricole. Les cultivateurs, les organi¬ 
sations de cultivateurs et les 6tablissements commerciaux en rapports 
avec Tagriculture, ainsi que le Gouvernement Federal, sont devenus 
les plus importants usagers des statistiques agricoles. 

Outre six divisions de statistique k Washington, connues sous la 
denomination collective de “Estimation agricoles”, le Bureau d’Econo¬ 
mic Agricole compte 41 bureaux r^gionaux desservant chacun un ou 
plusieurs Etats. Trente-cinq de ces bureaux exercent leurs activit6s 
en collaboration avec des D6partemen;ts d’Etat pour TAgriculture ou 
des colleges d'agriculture. La cooperation entre les Etats et le Gouverne¬ 
ment Federal evite les doubles emplois et permet la preparation d’esti- 
mations plus detailiees du point de vue geographique qull ne serait 
possible de le faire en employant seulement des fonds federaux. 

Les plus importantes methodes de reunion de renseignements statis¬ 
tiques sont: 1) enumerations completes, dont les recensements agricoles 
federaux et dans 12 Etats, la preparation du coton, et Tindustrie laitiere. 
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sent des exemples; (2) Temploi de questionnaires envoyes et retourn6s 
par la poste; 3) observations sur place et contacts personnels par des 
fonctionnaires techniques; 4) mesurages et d^nombrement efFectu^s 
sur place par des fonctionnaires techniques, et 5) interviews d’echantil- 
lons de cultivateurs ou de pr6parateurs de produits agricoles, choisis 
d’avance suivant une methods objective. 

La plupart des estimations de r^coltes et de cheptel faits par le Bureau 
sont basees sur des avis de changements re 9 us par la poste ou obtenus 
sur place par le personnel technique, changements qui sont mis en rap¬ 
port avec les resultats du recensement quinquennal. Vu que beaucoup 
de renseignements re 9 us par la poste contiennent des erreurs systemati- 
ques significatives, on fait usage autant que possible, de methodes do 
regression pour corriger do tels ecarts s’ils sont constant. Toutefois, 
pour les prix re 9 us et payes paries cultivateurs, les renseignements 
re 9 us par la poste sont utilises tels quels non seulement par le Bureau 
d’Economie Agricole mais aussi par le Bureau du Recensement pour 
I’estimation de la valeur de la production agricole. 

Les besoins d’amelioration des statistiques agricoles les plus impor- 
tants peuvent se resumer comme suit: 

1) donnees plus compr^hensives et plus frequentes sur les changements 
technologiques (mccanisation, etc.) dans les operations agricoles et dans 
les formes; 

2) statistiques plus frequentes concernant le cheptel et I’eievage, y 
compris le betail engraisse pour les marches; 

3) statistiques distinctes concernant la production “commerciale”; 

4) specification regionale plus detaillee; 

5) plus grande precision dans Testimation de certains types ce phe- 
nomenes agricoles, et 6) presentation de donnees en termes do frequences 
et autres caracteristiques d’une population. 

II sera probablement possible de satisfaire k ces desiderata de la mani^re 
la plus rapid et la plus economique en donnant de Textension au program¬ 
me actuel d’enquete par interviews d'echantillons choisis d’avance suivant 
une methode objective, et une integration de telles enquetes avec des 
enquetes par correspondance se rapportant aux memos personnes— 
enquetes par correspondance “semi-controlees**—ou avee un rappel par 
interview des personnes qui n’ont pas repondu k Tenquete par corres¬ 
pondance—enquete par correspondance “controlee”. La frequence 
et la specification geographique, ainsi que les mati^res k inclure, depen- 
dront des credits affect^s k ce travail. Ce but ne pourra etre atteint k 
si peu de frais d’aucune autre manifere. 



THE SOCIAL SECURITY STATISTICS PROGRAM 

by I. S. Falk 

Social Security Administration 
(United States) 

Perhaps the most important characteristic of the social security sta¬ 
tistics program—as compared with the other statistical programs which 
are included on the agenda for this session—^is the fact that it takes its 
origin in social security program operations. Nearly all of the statis¬ 
tics which I shall review in this paper are designed to meet the specific, 
needs of social security program operations, evaluation, and planning; 
with few exceptions, the basic data are derived directly from program 
operations. 

The general interest and value of social security statistics, beyond 
their immediate significance for the social security programs, is of two 
kinds. In the first place, social security measures are sufficiently im¬ 
portant in our economy to make statistics based on their operation of 
more use for general economic and social analyses than is usually recog¬ 
nized. In the-second place, the size and continuity of the data pro¬ 
vide an opportunity for the development of benchmark series which 
are useful in themselves and on which current estimates of more general 
use can be based. 

In this brief paper I cannot attempt to discuss all the possible or sig¬ 
nificant uses of social security statistics. I shall describe only the major 
bodies of statistical data emanating from the social security programs. 
In general, I have selected for discussion those statistics which have 
significance beyond their direct or immediate administrative uses. I 
shall refer only incidentally to the development of derivative estimates 
for purposes of analysis, or to the general research program of the Social 
Security Administration. While our administrative needs largely de¬ 
termine what statistics are collected, it would require more space and 
time than is available to me to describe that program comprehensively. 

The body of statistics with which I am here mainly concerned derives 
primarily from the operation of two social insurance’ programs (the na¬ 
tional system of old-age and survivors insurance and the Federal-State 
unemployment insurance program), the three Federal-State programs 
of public assistance, and the Federal-State maternal and child health 
and welfare service programs. I shall also mention briefly the statis¬ 
tics derived from several related programs which are not administered 
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by the Social Security Administration but which should not be omitted 
from any general review of social security -statistics. 

Old -Age and Subvivobs Insubance and Unemployment Insubance 

About three-fifths of all jobs in the United States are covered by the 
national system of old-age and survivors insurance and about one-half, 
by the Federal-State unemployment insurances. The major exclu¬ 
sions are self-employment (including farmers and others in business 
for themselves), agricultural labor, domestic service, employment for 
nonprofit organizations, railroad employment, and government employ¬ 
ment.. Railroad workers and many government workers (Federal, 
State, and local) are covered by special systems which will be discussed 
briefly later. Substantially all workers in industry and commerce are 
covered by old-age and survivors insurance, and all such workers— 
except, in about three-fourths of the States, those employed by small 
firms—are covered by unemployment insurance. 

Both insurance programs provide for the regular collection of con¬ 
tribution, which are used for the payment of benefits in specified cir¬ 
cumstances. Under old-age and survivors insurance, the contribu¬ 
tions are made jointly by employers and employees, and the benefits 
are pa 3 ^able to insured workers aged 65 and over who retire from covered 
employment, to their dependent wives and children under 18, and to 
specified surviving dependents of insured workers who die. Under 
unemployment insurance, the entire contribution is paid by the em¬ 
ployers, except in 2 States which have employee contributions also; 
and the benefits are payable to individuals who recently earned wages 
in covered employment, who are able and available for work, but who are 
unemployed because of lack of work. Under both programs all persons 
in the specified employments are covered regardless of earningS} but 
contributions are required only on the first $3,000, earned in a year. 

Two major categories of statistics result from the operations of each 
of these insurance programs: (1) statistics related to employer re¬ 
porting of contributions, wages, and employment; and (2) statistics re¬ 
lated to claims and benefit payments. 

Wage and Employment Statistics 

Under the old-age and survivors insurance program, each employer 
subject to the program files a quarterly tax report with the Collector 
of Internal Revenue (Treasury Department) for the district in which the 
business is located or, in case of multi-State employers, for the district 
in which the headquarters office is located. These reports are then sent 
to the Bureau of Old-Age and Survivors Insurance of the Social Secu¬ 
rity Administration for processing. In addition to information with 
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regard to the amount of the contribution, each report contains a listing 
of all workers receiving taxable wages at any time during the quarter, 
the amount of taxable wages paid each worker, and the number of 
workers on the pay roll ending nearest the 15th of the last month of the 
quarter. Most employers having more than one place of business sub¬ 
divide the information on taxable wages paid individual workers accord¬ 
ing to establishment or reporting unit. In general, the reporting unit 
is a single place of business engaged in a single industrial activity, 
although in some cases it is necessary to accept groupings of units so 
that reporting will not be too great a burden on an employer. 

Under the unemployment insurance program, employers submit to 
the appropriate State unemployment insurance agency quarterly 
contribution reports which give the amount of total and of taxable wages 
paid during the quarter and the number of workers on the pay roll 
ending nearest the 15th for each month of the quarter. For multi¬ 
unit employers, the data are given for separate establishments or repor¬ 
ting units. Employment and wage data are compiled from these reports 
by each State agency, and are sent to the Bureau of Employment Se¬ 
curity of the Social Security Administration in accordance with standard 
reporting procedures. Each State agency also obtains (for use in bene¬ 
fit determinations), either with the quarterly contribution report or 
at the time a worker is separated from employment, information on the 
taxable wages of individual workers. 

Over the past ten years, repeated efforts have been made to simplify 
reporting requirements for employers by making it possible for an em¬ 
ployer to submit the same contribution and wage report to both the 
Federal and State agencies. Differences in coverage and in other pro¬ 
visions of the Federal and State laws have prevented any general achieve¬ 
ment of this goal, although many States have arranged their report¬ 
ing forms so that the quarterly listing of names and wages of individual 
employees can be prepared, by use of carbon paper, simultaneously with 
the preparation of the corresponding part of the Federal report. 

In order to assure maximum comparability of the wage and employ¬ 
ment data obtained from these two sets of contribution reports, the 
Social Security Administration has; since about 1940, undertaken 
to promote the uniform industrial classification of employers (and estab¬ 
lishments) reporting under the two insurance programs. The res¬ 
ponsibility for the classification of new firms and foi* periodic resurveys 
of the nature of business of reporting firms is carried by the Bureau of 
Old-Age and Survivors Insurance, which sends the information to the 
State unemployment insurance agencies. If a State agency questions the 
classification assigned to a particular establishment, or has more recent 
information on the nature of its business activity, it informs the Bureau 
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of Employment Security and the Bureau of Old-Age and Survivors In- 
surance and agreement is reached on the classification to be used in both 
sets of records. 

Several different types and series of employment and wage statistics 
are derived from these records. 

Monthly employment data. Prom the unemployment insurance reports, 
data are available on employment by month and on total and taxable 
wages by quarter, distributed by State and by industry within each 
State. The data are sent to Washington by the State unemployment 
insurance agencies on two different schedules. One is on an annual 
census basis, and includes data for all employers subject to the State 
laws during the year. The State-industry tabulations prepared by the 
Bureau of Employment Security from these State reports are released 
during the latter part of the succeeding year. In order to provide data on 
a more nearly current basis, the State agencies also prepare quarterly 
reports, due in Washington 4 months after the end of the quarter to which 
they relate, based on data from employers who reported for the pre¬ 
vious and for the current quarters in time to meet the deadline date. 
From these “matched-employer’’ reports, estimates are calculated by 
relating the trend in the sample data to a base, or benchmark, derived 
from the last available annual report. 

In addition to their use by the State unemployment insurance agen¬ 
cies and the Social Security Administration for administrative and 
program purposes, these monthly employment statistics are widely 
used throughout the government and by private groups interested in 
basic data on employment and wages. In spite of the coverage limi¬ 
tations of the data, they are the most comprehensive body of monthly 
employment and quarterly wage statistics available. Two major uses 
of the data by other agencies might be mentioned. The Department 
of Commerce use the wage figures extensively both in it^ computation 
of the national income and in its series of State Income Payments; 
and it uses the employment data in estimating full-time equivalent 
employment and average annual wages and salaries. The Bureau of 
Labor Statistics also uses the employment statistics periodically as a 
benchmark to which their current-sample national employment series 
is adjusted. 

In order to correct for the omission of employment and wages in 
small firms not covered by unemployment insurance, estimates of such 
employment and wages are made on the basis of old-age and survivors 
insurance tabulations described below, and these are added to the 
unemployment insurance figures. There are a number of technical 
problems involved in the • development of satisfactory benchmark em¬ 
ployment data for the complete social security coverage. We have under 
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way a number of special studies which we anticipate will result in 
improved benchmark employment and wage statistics. 

All of the State unemployment insurance agencies tabulate and publish 
monthly employment data (for covered employment) by industry, for 
the State, and in some States for local areas within the State. Some of 
these agencies have also been interested in the preparation of current 
employment estimates for all nonagricultural employment. During 
the past year the Bureau of Employment Security and the Bureau of 
Labor Statistics have entered into a cooperative working arrangement 
for the development of employment and related data for the nation, 
the States, and local areas. In this project, the details of which are 
still being worked out, the major responsibility for the collection 
and publication of State and local area data will be placed, wherever 
possible, in the State unemployment insurance agencies. The same 
sample data will be used by the Bureau of Labor Statistics in preparing 
national series. 

Business population statistics, • Erom the quarterly employer tax 
returns, the Bureau of Old-Age and Survivors Insurance has available 
each quarter information on about 2 million employers. Counts of 
certain items on the reports are obtained each quarter in the course of 
the routine accounting operations. Once a year—in earlier years for 
the third calendar quarter and now for the first calendar quarter of 
the year—the Bureau tabulates data on the number of employers, their 
aggregate employment for the month of March, and their taxable pay 
rolls for the quarter, classified by various combinations of size-of-firm, 
industry, State, and county. Tabulations have also been prepared on 
an establishment or reporting unit basis, but these are subject to a degree 
of estimation (as is the aggregate employment item in the 8ize-of-fi;rm 
tabulations) since a substantial but decreasing number of employers fail 
to report the number employed as on the 15th of the month and 
none is required to report this figure for separate (multiple) establish¬ 
ments. 

These tabulations are the only available source of statistics in inter- 
censal years on size-of-firm for virtually all industry and comjnerce. 
The data are used by the Social Security Administration in analyzing 
the characteristics of employees covered under old-age and survivors 
insurance, the number of employers and amount of employment and 
wages included under old-age and survivors insurance but excluded 
from unemployment insurance. The statistics also have considerable 
general interest to anyone who is studying the characteristics of the 
business population, the relative importance of small and large firms 
in different industries, the concentration of employment and wages in 
fijrms of different size, and similar problems. 
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The Bureau of Old-Age and Survivors Insurance also tabulates each 
quarter, for the Office of Business Economics of the Department of 
Commerce, data on the number and characteristics of newly established 
and discontinued business by size>of-firm, State, industry, and cir¬ 
cumstance surrounding the “birth” or “death.” The business birth 
data are derived from the employer’s application for an identification 
under old-age and survivors insurance. The quarterly business death 
statistics are procured from notices of discontinuance of business trans¬ 
mitted by the Collectors of Internal Revenue, supplemented by files 
of inactive firms in the Bureau of Old-Age and Survivors Insurance. 
The data are used primarily by the Office of Business Economics, in 
connection with the preparation of current estimates of business popu¬ 
lation and business turnover analyses. 

Employ era covered by unemployment insurance. Data are also Wail- 
able from the State unemployment insurance agencies on approximate^ 
ly 800,000 employers covered by the unemployment insurance program. 
All but one of the States have ex;perience-rating provisions whereby 
contribution rates of individual employers may be varied from the 
standard rate. Annual tabulations classify employers under the State 
program by industry, tax rate, and size of annual pay roll. The data 
are used primarily for analyses of factors affecting employer’s employ¬ 
ment experience, variation in tax rates for firms of comparable type and 
size under different experience-rating systems, and similar problems. 

Annual employee wage statistics. For 1946, annual wage credits 
amounting to about $67.8 billion, or about two-thirds of all civilian 
wage and salary payments in that year were recorded in the old-age 
and survivors insurance accounts of 49.5 million workers. In spite 
of the limitations that result from exclusion of certain employments and 
from lack of information on earnings in excess of $3,000 in a year, the 
records of individual earnings, year by year, under the old-age and sur¬ 
vivors insurance program provide a unique body of statistical data 
of potentially wide value and usefulness. 

Two sets of employee tabulations are prepared annually by the Bureau 
of Old-Age and Survivors Insurance. The first is based on a 3 percent 
sample of the individual employee wage records during the last calendar 
year for which wage recordings (in the old-age and survivors insurance 
accounts) have been completed. The tabulations vary somewhat from 
year to year, but in recent years have included distribution of workers 
by age, sex and color, annual taxable wages, number of calendar quar¬ 
ters in which the worker was employed during the year. State, and in¬ 
dustry in which employed, and whether or not the worker changed 
his employer. State, or industry during the year. Annual tabulations 
of this kind are now available for each year from 1937 through 1945; 
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initial operations to prepare the tabulations for the year 1946 are now 
in process. Special tabulations have been made for some years for 
workers with wage credits in all four quarters of the year, who may be 
presumed to have worked primarily if not exclusively in covered em¬ 
ployment and whose taxabje earnings therefore closely approximate 
their total annual earnings (up to the maximum of $3,000 recorded for 
tax purposes). Special tabulations have also been made in a number of 
years for workers first .employed in covered industry (since the begin- 
ing of the program in 1937) in the specified year. The majority of such 
workers are now persons newly entering the labor force, and their quar¬ 
ters in covert employment and taxable earning during the year are 
consequently low. 

The Social Security Administration uses this time series of annual 
data in analyses of year-to-year changes in the employment and earnings 
Characteristics of covered workers, in estimates of future administrative 
work loads and of levels of earnings under old-age and survivors insurance 
in analyses of alternative eligibility and benefit specifications for old- 
age and survivors insurance and unemployment insurance, and in studies 
of disability and health insurance. 

Work history data. Annual data represent only single year’s employ¬ 
ment and earning experience of workers covered by the insurance pro¬ 
grams. Eligibility for benefits—and more particularly the amount 
of benefits under old-age and survivors insurance—:are dependent 
on the work and wage patterns over the working lifetime. The Bureau 
of Old-Age and Survivors Insurance has consequently developed 
a second series of tabulations—based on a 1 percent sample—showing 
the work and wage patterns of workers in covered employment at any 
time since the inception of the old-age and survivors insurance program 
in 1937. These individual work history statistics provide information 
on the number of persons who have contributed to the insurance system 
and the cumulative amount of their contributions, as well as the number 
who meet the requirements of insured status; they also provide distribu¬ 
tions of workers by age, sex, and color, by number of years and specific 
years in covered employment, cumulative number of quarters of employ¬ 
ment, annual and cumulative wages. 

Economists and statisticians will immediately recognize the great 
potential value and usefulness of both the annual earnings and the indi¬ 
vidual work-history tabulations. The two series* are now available for 
a period of nine years. We have begun to analyze the trend and 
patterns of employment and earnings revealed by the series, with special 
relation to their implications for the social security program. The 
opportunities for more general analysis of the data already published 
have only begun to be exploited. 
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It should be mentioned that many State - unemployment insurance 
agencies now prepare for their own use tabulations, from all or a sample 
of their wage records, of wages earned by individual workers during 
the calendar year, cross-classified by the amount of such wages which 
were earned in each individual’s most remunerative calendar quarter. 
These data are, for most States, basic factors in determining benefit 
rights. Nearly one-half the States are now sending copies of these 
tabulations to Washington on a voluntary basis. All State agencies 
estimate each year, as part of the regular statistical reporting program, 
the number of different workers earning wages under the program 
during a given year. 

Benefit Statistics 

From the point of view of social security program administration, 
the employment and wage statistics provide information on the popu¬ 
lation at risk—that is, the potential beneficiaries of the programs. Sta¬ 
tistics of benefit operations give us information as to the persons for 
whom the insured risk has materialized and the way in which the program 
affects them. The benefit statistics, like the employment and wage 
statistics, reflect the operations of the economy and can be used 
to trace some of the interactions between the social security program 
and other factors affecting the Nation’s economy. 

Old-age and survivors insurance benefit statistics. Two main types 
of statistics have been developed relating to old-age and survivors in¬ 
surance beneficiaries. One is obtained directly from claim and benefit 
records and includes tabulations of: (1) insured workers, on whose wages 
either retirement of survivor claims were awarded; (2) individual bene¬ 
ficiaries and their benefits; and (3) beneficiary families and their bene¬ 
fits. Tabulated data include information with respect to marital status, 
age, sex, race, insured status, type and amount of benefit, data of en¬ 
titlement to benefits, and date and cause of termination of benefits. 

The extent to which old-age and survivors insurance benefits meet 
the needs of' beneficiaries and fulfill the objectives of the Social Secu¬ 
rity Act depend to a very large degree upon the additional resources 
which beneficiaries have. The Bureau of Old-age and Survivors Insu¬ 
rance has consequently made a number of field studies of retired and 
survivor beneficiaries in selected localities. In these surveys infor¬ 
mation has been obtained on the income, employment status, living 
arrangements, and assets and liabilities of beneficiary groups and, in 
more recent surveys, on the cost of medical care for beneficiaries during 
the survey year, number of children outside their households, and amount 
of payments covering joint expenses in households where beneficiaries 
and relatives lived together. 
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While these statistics afe primarily useful in connection with the 
administration and development of old.age and survivors insurance, 
they provide a significant body of information about members of two 
groups in our population—-the aged and the widows and orphans—which 
is of considerable potential interest to economists and sociologists 
and to legislators and others concerned with the welfare of these 
groups. 

Statistics related to unemployment insurance benefit operations. In 
most countries which have unemployment insurance systems, statistics 
based on unemployment claims data have long been used as indicators 
of changes in economic activity. 

Such statistics have been highly developed in this country.. Data 
on the volume of various types of claims filed are reported to Washing¬ 
ton by the State unemployment insurance agencies on a weekly and 
monthly basis providing an indication of the location, extent, and dura¬ 
tion of unemployment in employments covered by State unemployment 
insurance laws. Current claims data from the Railroad Retirement 
Board with respect to the railroad unemployment insurance system, 
and from the Veterans Administration with respect to veterans, re¬ 
adjustment allowances, are combined with the State unemployment 
insurance data and issued weekly by the Bureau of Employment Security 
to provide the most current series available relating to unemployment 
in the nation and each State. These data are used widely by govern¬ 
ment and private organizations interested in the current trends of 
unemployment. 

Although the unemployment insurance claims figures do not reflect 
all unemployment (they exclude workers unemployed beyond the 
benefit period, as well as those in industries not covered by the insurance 
program), they provide a current and sensitive index of industrial and 
commercial unemployment. Moreover, they provide a current and sensi¬ 
tive index of industrial and commercial unemployment. Moreover, tljey 
provide geographical distributions of unemployment—by State and by 
local areas. Current unemployment indicators for small geographic areas 
are invaluable in identifying problem areas in their early stages. Trends 
in new claims reveal the pattern of the impacts of new unemployment 
among covered workers and, when compared with data on waiting 
period and compensable claims, they provide an indication of the extent 
to which claimants are immediately reemployed or are employed before 
reaching compensable status. Claims data by local office areas are uselhl 
in analyzing local labor market conditions. 

More detailed information as to claimants and beneifioiaries is avail¬ 
able on a monthly, quarterly, and annual basis. Statistics are repcftted 
monthly by the State unemployment insurance agencies on the number 
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of weeks of unemployment for which payments were made, the amount 
of such payments, the number of first payments issued to claimants 
within their benefit years, and the number of instances wherein claimants 
exhaust all benefit rights to which they were entitled. Prom these data 
are derived figures on the average benefit amount, the number of different 
individuals receiving benefits during a year and the proportion of un¬ 
employed workers who exhaust benefits before they are reemployed. 

Quarterly reports indicating the potential duration of benefits pay¬ 
able to new claimants who are eligible for benefits, by weekly benefit 
amount, show the extent of protection against wage loss offered to cur¬ 
rent claimants under existing provisions of State laws, and reflect on a 
reasonably current basis the effect of changes in benefit provisions 
of State laws and in earnings levels. After claimants have completed 
their benefit period, reports are submitted comparing, for claimants 
with specified weekly benefits, the actual duration of benefits with the 
potential duration. 

There are five States which now have provisions in their laws for 
paying benefits that vary in amount according to the number of the 
worker’s dependents and these States are submitting statistics sihowing 
the effects of this provision. The data indicate the number and type 
of dependents on whose accounts increased benefits are payable, the 
amount of the increase, and something as to the relative earnings level 
of workers with and those without dependents (as defined in the 
legislation). 

All State unemployment insurance agencies submit data quarterly 
on the number of new claims allowed and disallowed, the length of 
time elapsed between the end of the benefit period and the date of pay¬ 
ment, the number of disqualifications (classified by disqualification issue 
and severity), and the number of appeals (classified by issue, source, 
Offect on claimant, and time required to dispose of them). These 
statistics serve principally to reflect the characteristics of program 
operations.* 

I shall not take the time to list a number of other statistical series 
that are used primarily for administrative purposes. I might, however, 
mention that two States, Rhode Island and California, now have tem¬ 
porary disability (cash sickness) insurance programs which are admi¬ 
nistered by the State unemployment compensation agency in close con-^ 
junction with the unemployment insurance programs. Data on claims, 
benefits, and beneficiaries under these temporary disability programs 
ave teported voluntarily by the State and are published with other so¬ 
cial security data in the Social Sccvrity Bulletin, 
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Public Assistance Statistics 

The public assistance programs are State-administered programs 
for makiag money payments to individuals who have been found to be., 
in need—that is, to have insufficient resources on which to live 
according to standards established by thq States. The Federal Govern¬ 
ment matches, up to specified amounts, State expenditures for assis¬ 
tance to needy aged persons, to the needy blind, and to dependent child¬ 
ren. There are no Federal grants-in-aid for general assistance 
aid to persons who are not within these specified categories). Pay¬ 
ments to needy persons outside of the three special categories are financed 
wholly by the States and localities. 

States having approved plans for the three special types of public 
assistance report periodically to the Bureau of Public Assistance in the 
Social Security Administration on the operations of those programs. 
All of the States and 19 large cities also make supplementary (volun¬ 
tary) reports relating to general assistance. 

Monthly data are available for old-age assistance, aid to the blind, 
aid to dependent children, and general assistance, and for all 51 juris¬ 
dictions (the 48 States, the District of Columbia, Alaska, and Hawaii) 
on the number of persons receiving assistance, the volume of assistance 
payments, and (by derivation) the average monthly payment per reci¬ 
pient. Data are also available on a monthly basis, on the number of 
applications received and acted upon during the .month, the number of 
applications pending at the beginning and end of the month, the number 
of cases carried forward at the beginning and end of the month. These 
data provide a rough current index of the impact of changing economic 
conditions on the circumstances of families at the margin of subsistence. 
The index is less sensitive than it might be because of the large volume 
of unmet need which we know, on the basis of special studies and ana¬ 
lyses, exists even in relatively prosperous times. Nevertheless, when 
combined with quarterly data on reasons for opening cases and semi¬ 
annual data on reasons for closing cases the figures reveal fairly clearly 
the effects of changing employment opportunities for recipients or mem¬ 
bers of their families, of changing costs of living and of the operation 
of the insurance programs. County data on number of recipients and 
total assistance payments which are reported semiannually, and data 
relating to general assistance in 19 large cities, .make possible analysis 
of local area differences and trends. 

I shall not • discuss all the other statistical series relating to public 
assistance which have primarily administrative uses. I would mention 
only one series—the semiannual data for all States on expenditures for 
public assistance payments and administration, showing amounts from 
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Federal, State, and local funds. In addition, I might refer to several 
special statistical studies now under way or. recently completed by the 
Bureau of Public Assistance and State public assistance agencies which 
volunteered to p( 5 ;ticipate in the studies. A study of recipients of old- 
age assistance in 21 States, which has just been completed, provides 
information on the age, sex, and other characteristics of the recipients, 
their living arrangements, the amount which the public assistance agen¬ 
cy had established as the amount the recipient needed to live on, the 
amount of the assistance payment, and the amount and sources of in¬ 
come other than assistance. Also completed recently is a special study 
of the causes of blindness, conducted by 20 States. A study of the me¬ 
dical aspects of public assistance which is now under way will provide 
statistics on the volume and costs of medical services of various types 
supplied to needy persons by selected local agencies over a 6-month 
period. 


. Statistics Relating to Maternal and Child Health and 
Welfare Services 

Special health and welfare services for mothers and children are avail¬ 
able in many localities throughout the country under the Federal State 
programs administered by the Children’s Bureau in the Social Security 
Administration. Federal funds help finance services provided by State 
health agencies through prenatal clinics, well-baby and child health 
clinics, or public health nursing services for infants, preschool children, 
and school children, and diagnostic and treatment services for crippled 
children. They also help finance special services provided by State and 
local welfare agencies to children—especially dependent and neglected 
children and those in danger of becoming delinquent—who are in their 
own homes, in institutions, or are in need of day care, or adoption. 
The Children’s Bureau also administers funds (at present on a postwar 
liquidation basis) which are used by State health agencies to pay for 
maternity and infant care for families of enlisted men in specified grades 
of the armed forces. 

Periodic reports by the State health and welfare agencies provide in¬ 
formation on the volume and kinds of services which are being made 
available to these special maternal and child groups in the population. 
Data are reported quarterly on the volume and types of maternal and 
child health services, services to crippled children, and the cost of medi¬ 
cal care for wives and infants of enlisted men provided under programs 
administered or supervised by State health agencies, and the number 
and living arrangements of children served by State and local welfare 
agencies. Annual reports include more detail on the characteristics of 
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childi:en receiving services^ and on the amounts spent and the personnel 
engaged in providing such services* 

Statistics reported under these programs, when used alone or in re¬ 
lation to other statistical data, give some idea of the accomplishments 
and also of unmet needs and gaps in the services currently provided^ 
For example^ the annual reports on personnel in the child welfare pro?- 
gram indicate that child welfare workers are concentrated in a small 
number of States and in urban areas out of proportion to the child popu¬ 
lation in these States and areas, while other sections of the country with 
large proportions of the child population have few specialized child wel¬ 
fare workers* Similarly, in some States the need for the expansion of 
the child welfare program to include service to children in their own 
homes is indicated by unduly high proportions of children receiving ser¬ 
vice in foster-famUy homes or in institutions* 

State agencies administering the crippled children’s program mainr 
tain registers of crippled children as well as records of services provided* 
In 1946 approximately 108,000 crippled children received diagnostic 
and treatment services at clinics financed in whole or part by Federal 
funds; while at the end of that year 442,000 were on the crippled child¬ 
ren’s registers maintained by the State agencies administering these 
funds. This latter figure includes, of course, only crippled children 
known to the agencies, not all those suffering from such disabilities* 
Work is now in progress on a standard classification of crippling con¬ 
ditions to be used by State agencies in reporting on services provided 
to crippled children under these programs. 

Although the program is now being liquidated, reference may be 
made to the statistics relating to the operation of the emergency 
maternity and infant core program. Between April 1943 and June 194f7, 
maternity care had been authorized for over 1,203,000 wives, and 
medical, hospital, and related services during the first year of life for 
approximately 217,000 infants, of men in the lowest four pay grades of 
the armed services. Monthly statistics are available on cases authorized 
Aud completed and quarterly statistics on types of services and costs 
of care provided under the program. 


Statistics fkom Bblatbo Proobams 

This review would be incomplete if it did not refer, however briefly, 
to, 9^ few of the more important statistical series derived from social 
security and related programs not administered by the Social Security 
Administration 

Bailroad ami related transportation workers in this country are now 
oQvered by a social insurance system providing retirement, survivor>. 
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disability, sickness, and unemployment benefits. From the contri¬ 
bution reports of employers covered under the railroad social insurance 
program, data are available on total and taxable wages (wages up to 
$300 a month) by quarter, and on the number of covered workers by 
month. The Railroad Retirement Board prepares annual tabulations 
of the number of workers covered under the railroad program, their 
annual taxable earnings and months of service in railroad employment, 
by age and by occupation. The Social Security Administration and 
the Railroad Retirement Board have in the past made a number of spe¬ 
cial statistical studies of workers having earnings under both programs 
during the course of a year. 

Statistics are also available monthly on the number of beneficiaries 
and amount of benefits paid under the railroad program. Reference 
has already been made to the use of weekly data on unemployment 
benefit claimants under the railroad program in'the insured unemploy¬ 
ment series prepared by the Bureau of Employment Security in the 
Social Security Administration. 

Most Federal Government workers are now covered under the Civil 
Service Retirement System. The Civil Service Commission publishes 
annual statistics on the number and characteristics of persons receiving 
retirement and disability benefits, or joint-survivor annuities and lump¬ 
sum death payments. 

The veterans’ program may be regarded as a social security program 
for a special group in our population. I shall not attempt to review the 
available statistics relating to veterans’ benefits. It may be of interest 
to you to know that the Bureau of Research and Statistics in the Social 
Security Administration has developed a series of comparable data on 
the number of beneficiaries and amount of benefits, by month, under 
the railroad, civil service, and veterans’ benefit programs as well as un¬ 
der old-age and survivors insurance. State unemployment insurance, 
and the two State temporary disability programs. To complete the 
series, we prepare annual estimates of benefits and beneficiaries under 
the more than 1,700 State and local employees’ retirement systems and 
of payments under the Federal and State workmen’s compensation pro¬ 
grams. We have not, as yet, been able to develop a method of estima¬ 
ting the number of persons receiving payments under more than one 
program, and thus to arrive at an unduplicated count of the number 
of individuals involved. The composite series, in conjunction with data 
on recipients of public assistance, does give us an approximate measure 
of the extent to which various groups in the population are reached by 
the existing social security and related programs. 
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Summary 

Because the social security program includes within its compass both 
persons actively at work and persons who are temporarily or perma¬ 
nently out of the labor force, statistics derived from the operations of 
that program can be used to observe and analyze many aspects of the 
social dynamics of our economy. The main inadequacy of the statis¬ 
tics for purposes of general economic analysis stems from one of the 
major limitations in the existing social insurance program—its failure 
to cover workers in all employments. For the groups covered, the 
social security statistics provide information of a kind not other¬ 
wise available, and of a degree of accuracy not easily achieved through 
other methods used in the collection of large-scale economic or social 
statistics. While all of the basic data rest upon a system of operating 
reports for the entire population covered by the programs, many of 
the tabulations are prepared on a sample basis. 

As indicated earlier, the major emphasis in the development of the 
statistics is upon their use in the administration of the social security 
program, and in studies and analyses of the effectiveness of that pro¬ 
gram and the extent of unmet social security needs. In order to carry 
out the responsibility imposed by the Social Security Act for “studying 
and making recommendations as to the most effective methods of 

providing economic security.we must, of course, go beyond the 

statistics derived from the operations of existing programs. 

In studies of the social security needs and the problems of extending 
coverage to groups now excluded, we have turned to data from the cen¬ 
sus of population, from special studies of farmers and agricultural work¬ 
ers, and from other sources. In some cases, we have ourselves under¬ 
taken field studies of such groups as domestic workers or the urban self- 
employed; but, so far as possible, for supplementary statistics we rely 
on data collected by other agencies. 

In our studies of disability and health insurance, also, we rely on data 
from other sources—studies of the incidence and characteristics of dis¬ 
ability under private benefit programs or under foreign social insurance 
systems, the results of special surveys, the operations of many kinds 
of public institutions, the data on medical personnel and facilities col¬ 
lected by the Public Health Service or private organizations, and similar 
data. In this area of study, we have also found it necessary to compile 
some information ourselves, such as periodic reports on the number of 
prepayment medical care organizations,, their membership, and the 
types of service provided. 
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Our studies of the financing and the fiscal aspects of the social secu¬ 
rity programs rely partly on cost data derived from social security pro¬ 
gram statistics, partly on data from tax yields, national and State income 
estimates, and similar information from other sources. It would take 
me too far afield to discuss the uses we make of such data in analyses 
of relative fiscal capacity of States and localities or of the impact of 
social security contributions and benefit payments on the economy as 
a whole, on States, on economic groups, etc. 

Although our major interest is in the use of social security statistics 
for administrative and other program purposes, the Social Security 
Administration has always been alert, to the other important uses of 
social security data, and has attempted to take into account other pub¬ 
lic interests than its own. Limitations of budget and the fact that we 
are not, under existing legislation, able to prepare tabulations or do 
other special work on a cost reimbursement basis except for Federal 
agencies, make it impossible for us to respond to many requests for 
special tabulations or listings of information that could easily be ob¬ 
tained from our basic statistical records. 

In closing, I would again call the attention of statisticians and eco¬ 
nomists to the growing body of data available as a result of our regular 
periodic tabulations. Most of these data are published regularly in 
the Social Security Bulletin or Yearbook; others appear in special re¬ 
ports. Even without the elaborations that would be desirable for many 
purposes, this body of data affords many opportunities for analyses of 
a wide variety of economic and social problems. 


R^sumi 

Les statistiques de securite sociale decoulent principalement de la 
mise en pratique de deux programmes d’assurance sociale (le sysi^me 
national d’assurance-vieillesse et assurance-veuves et orphelins, et le 
programme Federal-d’Etat (Federal-State) d’assurance-chomage, des 
trois programmes Federal-d’Etat d’assistance publique, et le programme 
F6d6ral-d’Etat d’aide maternelle et infantile. 

Deux categories principales de statistiques resultent de Fapplication 
de chacun des programmes d’assurance: les statistiques, bashes sur les 
donnees fournies par les patrons, concemant les primes, les salaires et 
le personnel et les statistiques ayant trait aux demandes d’indeirmites 
et aux indenmites pay6es’. 
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Des renseignements relatifs aux prinies d’assurance-chomage on ob- 
tient des chiffres sur le chomage par mois et snr les salaires totaux et 
imposables par trimestre; repartis par Etat et par cat6gorie d’industrie. 
Malgr6 le fait que les donn^es presentent certaines lacunes, elles forment 
Tensemble le plus coinpr6hensif de statistiques mensuelles de I’emploi 
et de statistiques trimestrielles des salaires dont on dispose. 

Des statistiques du nombre d’etablissements industriels et coinmer- 
oiaux et des tableaux annuels d’employ^s sont pr6par68 au moyen des 
informations sur la taxe d/ payer par les patrons suivant le programme 
d’assurance-vieillesse et assurances-veuves et orphelins. Les tableaux 
sur les etablissements comprennent, pour un trimestre de chaque annee, 
des chiffres sur le nombre de patrons, leur personnel et les salaires pay6s, 
classes suivant la grandeur de T^tablissement, la categorie d’industrie, 
I’Etat et le district et, pour chaque trimestre, des renseignements sur le 
nombre et les caract^ristiques d’entreprises nouvelles ou ayant cess6 
d’exister. Les tableaux annuels relatifs aux personnes employees don- 
nent e.a. des renseignements sur la classification des travailleurs par 
&ge, sexe, race, trimestres pendant lesquels on a 6t6 occupe, FEtat Fin- 
dustries oh on est employ^, changements de salaire et d’occupation 
pendant Fannie. 

A Faide des rapports relatifs aux demandes d*indemnit6 et aux indem- 
nit6s payees d’assurance-viellesse et assurance-veuves et orphelins on 
prepare des tableaux sur les travailleurs assures, les b^neficiaires indi- 
viduels et les familles-ben^ficiaires. Ces tableaux comprennent des 
renseignements sur F6tat matrimonial, F&ge, le sexe, la race, Fetat d’as- 
urance, le type et le montant de Findemnit6, la date de Fentr6e en jouis- 
sance et les date et cause de la cessation de Findemnite. Ces chiffres, 
resultant de Fapplication du systfeme d’assurance, sont completes par 
des enquetes sp6ciales qui fournissent des renseignements sur la situa¬ 
tion 6conomique de groupes de ben^ficiaires dans certaines villes. 

Des chiffres sur Fimportance de diff^rents types de demandes d’indem- 
nit6 re9ues sont communiques k Washington par les agences d’assurance- 
chdmage de FEtat, hebdomadairement et mensuellement, ce qui permet 
d'obtenir des renseignements sur la repartition geographique, Fexten- 
sion et la duree du chdmage assure. Des chiffres plus detailies ur les 
demandes d’indemnite et les beneficiaires sont disponibles par trimes- 
tre et par an. 

Les Etats qui ont des plans approuves d’assistance-vieillesse, d’assis¬ 
tance aux aveugles et h des enfants, soumettent mensuellement des 
rapports sur Fapplication de ces programmes, et tons les Etats et 19 
grandes villes envoient volontairement des rapports sur Fassistance 
g6n6rale. Ces rapports contieiment des chiffres sur le nombre des 
personnes assist6es» les paiements, les demandes d’assistance et sur le 
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nombre des cas nouveaux et des cas ayant pris fin. L’Administration de 
S6curit6 Sociale procfede aussi k des etudes sur les caract6ristique8 eco- 
nomiques et sociales des beneficiaires. 

Le Bureau dejeunesse de 1*Administration de Securite Sociale rassem- 
ble trimestriellement des chiffres sur les activites relatives aux program¬ 
mes concernant Taide maternelle et infantile, les soins aux enfants boi- 
teux, et le nombre des enfants profitant des services d'assistance de 
TEtat et locaux ainsi que les arrangements pris en ce qui concerne ces 
enfants. Des rapports annuels contiennent des renseignements plus 
detaill6s; on y trouve des donnees sur les caracteristiques des enfants 
assistes, sur les d^penses et sur le personnel. 

La plupart des chiffres sont publics dans le ‘'Social Security Bulletin” 
ou le “Yearbook”; d’autres sont donnes dans des rapports speciaux. 
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Discussion 

Mr. Stone: / 

Dr. Falk has given us a most impressive picture of the wide range of 
statistical data which the Social Security Administration is able to give 
us now. He has called attention to two limitations: one is that they 
give us the figures only on the industries which are covered by the law, 
which cuts out a significant section of employees; the other is the limi¬ 
tation to the first $3,000 of earnings a year. At the time when the law 
was adopted, it is quite conceivable that it was a perfectly reasonable 
limitation because very few wage-earners earned more than $3,000. 
But with the considerable increase in earnings which has taken place in 
the last few years a large body of wage-earners are earning consider¬ 
able more. I wonder whether Dr. Falk could exercise his ingenuity in 
getting the actual earnings figures in spite of the limitations so far as the 
payment for security is concerned. 

Dr. Falk: 

May I say that the comments are well taken. We have been trying 
in various of our bureaus to work out methods whereby, through esti¬ 
mates of various kinds, the limitations of the data may be reduced to a 
minimum. 

As to the $3,000 limit, we assume that when the Congress gets around 
to a review of the social insurances, the limit will be raised to take into 
account the upward trend, or higher level, of wages. But there will 
then remain a new ceiling. Let me point out that in the unemployment 
insurance statistics, we do get reports of total payrolls for those who 
are covered by unemployment insurance. We estimate regularly aggre¬ 
gate earnings over $3,000 in industries covered by old age and survi¬ 
vors insurance. For special research purposes, approximate estimates 
are made from time to time of the presumed distribution of the earnings 
in excess of $3,000 by reference to other series. 

The limitations that result from coverage present much more complex 
problems and constitute one of the most important, reasons why per¬ 
sons using these series must take into account the substantive charac¬ 
teristics that are behind the data. The real remedy for that problem is, 
of course, a substantive one. We must wait on expansion in the cover¬ 
age of the insurance systems by Congress; an amendment .to our laws 
which we have frequently recommended and which we hope very much 
will come in the near future. 
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ANALYSE DES LIAISONS DE PROBABILITE 

par Georges Darmois 
University de Paris {France) 

On pent ainsi nommer tout le corps des recherches qui visent k la 
representation, eventuellement ^ Texplication, de liaisons stochastiqiles 
par rintermediaire de ce qu’on pourrait appeler.en general.des variables 
aleatoires cachees, et que, dans la terminologie de Tanalyse factorielle, 
on qualifie justement de facteurs. 

Ces variables cachees sont, dans les recherches classiques, ind^pen- 
dantes en probabilite, et les variables observees sont supposees en etre 
des fonctions, mais ce sont, disons les plus simples de la hierarchie des 
fonctions. En fait, ce sont des ^ombinaisons lineaires de facteurs inde¬ 
pendants; dans la notation habituelle, ce sont des combinaisons pon- 
derees de variables centrees et normees (c’est-^-dire E(a) = 0; E{a^) == 1, 
si a est un facteur). 

A proprement parler, Tanalyse factorielle classique ne vise qu'4 re- 
produire au mieux, par des conditions d’optimum portant en particulier 
sur le nombre des facteurs, les moments du second ordre de la loi de dis¬ 
tribution etudiee, ou encore, ce qui revient au m^me, ^ retrouver au 
mieux les coefficients de correlation. 

On pent, se pla 9 ant d’abord a un point de vue th^orique, etendre le 
problfeme de I’analyse factorielle en gardant la notion gen^rale de Tinde- 
pendance des variables cachees, mais en permettant aux variables ale- 
atories etudiees d’en etre des fonctions plus generates que des fonc¬ 
tions lineaires. 

On peut ainsi representer, comme nous le verrons, des lois de proba¬ 
bility qui ne rentreraient pas dans la classe, theoriquement assez res- 
treinte, de celtes que fournissent les schemas lineaires. 
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Lea fonctions des facteurs dont nous allons nous occuper ne sauraient 
toutefois garder toute leur g6neralit4. En effet, toutes les variables 
al^atoires d’un m§me champ, ou comme le dit M. F r 6 c h e t, corres- 
pondant k une mSme cat6gorie d’epreuves, sont d^terminees quand F^p- 
reuve est faite, et peuvent ainsi etre considerees comme des fonctions 
d’une meme variable, qu’on peut appeler I’al^atoire fondamentale. Or, 
ces fonctions d’une meme variable peuvent presenter tous les degr6s 
de la d^pendance stochastique. Pour cette raison, nous donnerons k 
ces fonctions des facteurs certaines propriet6s de regularity. 

Par example, si une loi de probability k deux variables et peut 
etre reprysentye avec deux facteurs et par les yquations ; 

(1) iCj = /j(ai, oct) = /*(«!, Ui) 

nous ferons sur et /a les hypothfeses nycessaires pour que et puis- 
sent etre pris comme de nouvelles cpordonnyes du point aiyatoire (x^,x^, 
et qu’on puisse passer par les mythodes classiques du calcul diffyrentiel 
d’une density de probability k Fautre. Et nous parlerons des courbes 
ag = 0^**, etc. 

Nous nous bornerons ici aux distributions absolument continues. Soit 
Soit alors, pour les variables Xi et X 2 la probability yiementaire: 

a(x^)dxi. a^i(x2)dx2 . 

a(xi)dxi est la probability elementaire marginale de Xi^ a^\(x 2 )dx 2 est 
la probability yiymentaire Uye de x^, 

II y aura liaison stochastique si a^^(x 2 ) dypend effectivement de x^. 
Nous allons dans ce cas, chercher une solution du type (1), mais une 
solution particuliyre en ce sens que nous prendrons comme premier 
facteur x^ 

*1 = «! *2 = OC^) 

et rysolvant la deuxi^me equation par ag nous aurons: 

^2 = ^ 2 ) 

on voit immydiatement qu’on doit avoir; 

( 2 ) ^:=a-^{x,) 

0 X 2 , 

( 3 ) if >2 -= + C(xi) 

Fxi(x 2 ) est la fonction de rypartition de X 2 liye par x^, C(xi) arbitraire. 
Nous avons d’abord la solution particuli^re ag = (Xg) 

On voit qu’on peut introduire en espace k trois dimensions Xi, Xg, Z. 
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La surface repr6sent6e p^r I’^qUation Z = F^i {x^) a pour sections par 
les plans les courbes de repartition de li^e par x^. Les sec¬ 

tions par les plans Z = (7^® se projettent sur le plan des x^ a ?2 suivant les 
courbes ag = (7‘® qui, associees aux droites Xi = C*®, constituent un sys- 
t^me de ooordonn6es curvilignes ind6pendantes en probabilite. 

La construction de ces courbes a.^ = (7*® peut s’obtenir par une 
methode geohietrique. Si Ton consid^re une bande infiniment etroite 
^i> + ^^1 dans laquelle aj 2 est une aleatoire li6e, la probabilite totale, 

disons la masse totale de cette bande est a(xi)dxi. Et le rapport k 
cette mass totale de la masse partielle telle que Tordonnee soit inferieure 
k x^ est justement F^i (x^), c’est k dire ofg* Les courbes a 2 == qu’on 
obtient par cette construction seront dites associees aux droites x^ = (7^® 
ou mieux en raison de la sym6trie, que ces deux families constituent 
un reseau de courbes associees. 

Remarque, Nous pouvons observer que Tindependance des variables 
aleatoires x^ et est evidente, car pour une valeur fixee quelconque 
de Xi, la loi de probability de est toujours la meme. est r6partie 
uniformyment entre zero et un. 

Cette remarque rend intuitives les generalisations, en particulier 
celle-ci: 

Si Ton remplace par une famille de courbes la famille x^ = (7‘®, on voit 
que la construction prec6dente, faite cette fois sur la bande constituye 
par deux courbes infiniment voisines fournira des courbes associyes. 
On voit done qu’il existe une infinity de reseaux de ce genre. En par¬ 
ticulier, k une famille quelconque de droites parall61es, on peut associer 
une famille bien dyterminye. 

On sait que pour une loi de Laplace-Gauss, cette famille associye se- 
rait encore composye de droites, et que les directions de deux families 
sont conjuguyes dans Tellipse indicatrice. Disons simplement que 
cette propriyty est caractyristique de la loi de Laplace-Gauss, en ce sens 
que si deux ryseaux associys diffyrents sont composys de droites, la loi 
de probability est nycessairement de Laplace-Gauss. 


Loi db pbobability a tiiois vabiablbs 
Considyrons une loi yiymentaire de la forme: 

«(«!, ^^ 2 * A^i^2{x^)dx^ 

Si Ton prend: *2 (ajj) a pour valeur la fonction de rypartition 

de Uye par le couple x^, X 2 - C’est une variable indypendante du cou¬ 
ple, et les surfaces x^ = (7‘® seront dites associyes k la congruence des droi¬ 
tes Xi = a ?2 == 
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Si maintenant, consid^rant la loi k 2 variables on fait la construc¬ 

tion de Tun des r^seaux de fonctions associ^es, on aura determine trois 
facteurs 

X2) a^(xi, x^) ot^{xi, X2, x^) 

Et cette construction peut se faire a partir d’une congruence qui gene¬ 
ralise celle des droites x^ = x^ = C^. II suffit en effet dans le tube 
infiniment petit qui entoure une courbe de la congruence, de determiner 
en un point le rapport de la masse partielle s’^tendant de Tinfini au point 
consid6r6 h la masse totale, on aura la variable Les variables a^, 
ag sont celles de deux surfaces associees de la congruence. 

On voit que nous avons d^j^t demontr6 quclques propositions gene- 
rales, valables pour les lois absolument continues: 

a) II existe une infinite de decompositions de type (1) correspondant 
^ des reseaux de courbes associees. 

b) Si Ton applique la meme methode k des variables independantes 
on voit qu’il existe une infinite de couples/^(ai a 2 )>/ 2 («i “ 2 ) q«i, partant 
•de variables independantes, redonnent des variables independantes. 
Cette proposition etait bien connue pour les lois de Laplace-Gauss. 

Autres dAcomfositions 

Considerons par exemple une famille de courbes ferm6es qui grandis- 
sent et s’enveloppent k partir d’un point O, et une courbe pp formee d’un 
axe parti de O et allant k I’infini que fixera sur chaque courbe ferm4e 
une origine Jl. 



Si Ion marque un sens sur les courbes ferm^es, on pourra, dans 
chaque anneau infiniment petit, d^finir un point M par le rapport 
<*2 A la masse totale de I’anneau de la masse partielle comprise entre n 
et M. Les courbes a, = seront analogues & Po: si cq est le parambtre 
des courbes ferm^es, aj et seront encore deux variables al4atoires 
independantes. 
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II est remarquable qu’a une famille on puisse associer une 

infinite de families, en choisissant arbitrairement Tq. Par exemple, 
il est bien connu que, dans une loi de Laplace-Gauss, les ellipses et les 
droites issues du centre constituent un reseau d’associes. Mais on voit 
qu’on peut remplacer les droites par une famille de courbes, egalement 
issues du centre. Get ordre d’idees va nous amener k I’interpretation de 
la solution generate 

(3) <p = F^i (x^) + C(x,), 

Mais pour voir les choses bien clairement, il est preferable de faire 
d’abord une transformation. Les associees au sens particulier des droites 
= (7^® etant prises comme coordonnees, on peut toujours supposer 
les variables x^, X 2 ind6pendantes, et variables entre z6ro et un. La 
loi primitive est alors representee sur le carr6 de cote un. Appelons 
les variables x et y, Soit alors une courbe To* A tout point M, corres¬ 
pond une fonction que nous pouvons encore appeler arg, et qui repre¬ 
sente dans chaque bande le rapport k la masse totale de la masse 



partielle comptee a partir de tt. Pour le point M, — ^iM. Pour le 
point N c’est Q' H+KN = 1+n'iV. La courbe se compose de 

deux arcs dMuits par translation des deux arcs AB, BC de To- Mais 
on voit que dans la representation primitive les points P et Q ont 
pour images des points a Tinfini (ou plus generalement des points de la 
fronttere). Par exemple, si Vo est la premiere bissectrice, ag a pour valeur 
y—x si y—x > 0 et i+y—x si y—x < 0 . Une telle variable ateatoire 
est bien comme on peut le verifier detail, ind^pendante de H, 

On voit qu’il existe une infinite de faniiltes associ6es k une famille 
donn6e, mais les courbes representatives auront dans la representation 
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forimitive des points h Tinfini, ou en tout c^, seront composees de mor- 
ceaux. C’est ce qui donne k la solution partioulifere (p — 
impojptance toute sp6oiale. 

K^sultats g^ni6raux 

II est bien clair que ces r^sultats s’^tendent un espace a un nombre 
fini quelconque de dimensions (et meme k une infinite denombrable). 
De sorte qu’on pent, d’une infinite de maniferes, representer une loi de 
probability quelconque (absolument continue) par des expressions de 
la forme: 

=/i(ai,a2, ...,an) 

t = 1, 2, 71, oil les aj peuvent etre supposees ramenees k etre 

uniformes de z^ro k un, et sont des variables independantes. 

Comme d’autre part, toute distribution k deux, trois, variables 
peut ytre considyrye comme projection d'une distribution k un nombre 
supyrieur quelconque, de dimensions, on voit que toute loi, k deux vari¬ 
ables, par exemple, peut etre d’une infinity de maniferes reprysentee 
avec un nombre quelconque de facteurs indypendants. 

Un CAS PARTIOCJLtBRBMBNT INT^RBSSANT 

On sait que les thyories analogues k celle de Spearman, emploi- 
ent des facteurs communs et facteurs de groupes pour la reprysentation 
des corryiations. 

Con 9 ue d’une manifere gynyrale, cette idye prend la forme suivante: 
Soient n variables x^, et N facteurs a^, ag? •••> Considerons 

un groupe r de facteurs qui apparaitra dans tous les Xi, et n groupes 
Oiy O2, sans partie commune. Les expressions: x^ — /i(r, Gt) 

fournissent une gynyralisation des schemas linyaires classiques. II est 
k retiaarquer qu’on peut, de fagon trfes gynerale, obtenir une forme simple 
de la fonction caractyristique de la loi des ajj. En efFet: Wn) 

= ife*(%a;i+7i2^2+--+^n^n) peut dtre obtenue en deux ytapes. Lais- 
sant d’abord constants les facteurs du groupe r, les Xi ainsi liys sont 
ipdypendants entre eux, de sorte que la premiyre intygration donne une 
expression de la forme: 

^i(r, Ml) ^iir. Mg) ... ^„(r, md) ■ \ 

et que par une dernifere intygration, on a la forme explicite gynyrale 
Wg, Ur,) = Wi) ... ^n(r, Ur,)dr 

en notant dr 1’element de probability du groupe des facteurs communs. 
Sans ytudier plus avant la question de^savoir comment on reconnaitra 
si les ar| sont effectivement liys en probability et de quelle mani^re 
ils le sont, on doit remarquer qu’on peut trouver des diffyrences assez 
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profondes aveo le schema lindaire avec des coefficients de correlation 
mils, ce qui ne saurait se produire daiis le cas lineaire avec un seul 
facteur commun. 


Un cas pabticulier 

Soit X uniforme de 0 a 1, a uniforme de —1/2 e, +1/2, et independant 
de X, La relation y ^ ax dehnit dans un domaine traiangulaire une loi 
de probabilite a deux variables dont la loi eiementaire est donnee par: 
dxdy/x, II y a evidemment liaison de probabilite, la loi de y lieee 



est uniforme mais d’etendue proportionnelle k x, II est clair que la 
moyenne de y liee est nulle, ainsi que le moment E[y(x—\I2)] ce qui 
donne ce qu’on peut appeler Tindependance au second ordre. 

Les problemes pratiques 

On peut en se bornant au cas le plus simple du facteur associe k la 
variable ajj, indiquer quelques proprietes eiementaires. Reprenant 
les notations x et y et notant a le facteur associe k x, on aura y — f{Xya) 
' oil a peut etre suppose k repartition uniforme de 0 it 1. 

On voit que cette forme de relation met tout it fait en evidence des 
elements importants. Si Ton fait a = 1/2, on a ce qu’on pourrait appe¬ 
ler la ligne mediane (ou ligne de regression mediane, si ce mot de regres¬ 
sion ne parait pas dejit etendu it Texces). On aurait de meme les lignes 
quartiles, etc. 
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On pent se demander en particulier si toutes ces lignes pourraient 
etre des droites. La surface consid^r^e: a = F^(y) serait alors une 
surface r6glee. D’autre part, / doit etre monotone en a. 11 faudrait 
que Ton eut: 

y = xp{ 0 L) + q((x) 

Si le point xy peut parcourir toute la generatrice, le plan tangent fait 
un tour complet k moins que la surface ne soit developpable. II faut 
-done, si le point parcourt toute la generatrice que la surface soit un cy 
lindre de generatrices paralieies au plan directeur, soit p(a) = (7^® = Pq, 
et q(a) monotone. Ainsi toutes les droites sont parallfeles. 

Puis il peut aussi arriver que x soit borne. On peut le supposer posi- 
tif, et la condition de monotonie ne presente plus aucune difficultc. Le 
lecteur construira aisement de nombreux exemples, nous venons d’en 
donner plus haut un tres simple. 

Problkmbs d’a.justkment 

On peut remarquer que, dans un cas o(i la ligne mediane est supposee 
droite, le problfeme de la recherche de cette droite est analogue a celui 
de la droite de regression ordinaire. II convient alors d’insister sur 
le fait que la methode des moindres carres devrait etre replacee par 
la methode des moindres distances. II faudrait rechercher une droite 
telle que la some des distances parallfelement k Taxe des y (somme 
ponderee s’il y a lieu), soit un minimum. On trouve alors aisement 

1) que la droite cherchee doit etre une droite mediane dans le plan, 
c’est-^l-dire que les masses qu’elle separe doivent etre ou egales, ou veri¬ 
fier les conditions habituelles. 

2) que la droit qui joint les centres de gravite des masses egales doit 
etre parallfele k Taxe des y (j’enonce cette condition dans le cas le plus 
simple). 


Problbmbs d’optimum 

Beau coup plus encore que dans Fanalyse factorielle classique, il faut, 
pour choisir dans la famille iniinie des solutions possibles, imposer des 
conditions de simplicite et d’optimum adaptees k question que Ton 
etudie. , 

Il est certain que dans une loi de Laplace-Gauss k deux variables, 
avec une surface en cloche qui soit allong^e dans un certain sens, Tun 
des facteurs peut etre rattach^ k des parallfeles ayant cette direction, 
Tautre facteur 4tant rattach6 aux droites associ^^, ici conjuguees. 
Le premier facteur variera tris rapidement, et on peut lui imposer une 
condition d’extremum. S’il s’agit au contraire d’une cloche tr^s pointiie, 
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mais k peu prfes ronde, il serait naturel d’envisager un facteur rattache 
k des courbes ferm^es partant du sommet, et un facteur d’orientation 
des courbes associ^es. 

Si Ton imposait par exemple aux courbes ferm6es de renfermer Taire 
la plus petite pour une. probabilite donn6e, on trouverait les ellipses 
de la loi et on pourrait. prendre comme ttssoci6es des droites rayonnant 
autour du centre. 

Un kxemple assez simple de liaison par facteur commun 
On peut etudier en general le cas oil Ton aurait: 

Xi = «! + Cl a, + di 

= a2a2 + C 2 ccq + dg ag 

Les a, c, d sont des constantes. On peut former la fonction caracteris- 
tique methode generale indiquee. 

Bornons-nous au cas tres simple oil Ton a: 

Xi^CLiOL^ 

X 2 = ct2 OL 2 

Les OLiiOL^yOL^ suivent ind^pendamment une loi de Laplace Gauss cen- 
tree et- normee. On obtient aisement la fonction caract6ristique: 

_ 1 

<l> (Ml Mg) = ^ T+m|“+ Mj* 

On se trouve encore dans un cas oil le coefficient de correlation est nul. 
La loi obtenue d’ailleurs evidemment isotrope dans le plan Xi X 2 , et Ton 
peut remarquer que, dans ce plan, les cercles: 

=ol+x%= fil 

et les droites issues de Torigine x^/x^ == fgr/ffg forment un r^seau de courbes 
associ6es. On a done une autre representation avec deux facteurs. 


Conclusions 

Les propriet6s tr^s simples que nous avons indiquees et qu’on pour¬ 
rait aisement developper paraftront peut-6tre, au moins pour certaines, 
plus curieuses qu’utiles. II me serable qu’elles 6clairent le probl^me 
g6n6ral de I’analyse factorielle en montrant quelle large indetermination 
il pr6sente dbs qu’on sort du domaine, d6j4 tr^s 6tendu, des schemas 
lin6aires. On voit en tout cas qu’on peut esp6rer representer, par ces 
m6thodes, des liaisons de probabilite qui echappent aux methodes 
classiques d’analyse. 
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R4suin£ 

1) It is possible to generalize classical factor analysis by still consi¬ 
dering independent factors, but permitting the variates studied to be 
more general functions of these factors than linear functions. 

2) In the case of an absolutely continuous bivariate probability 
distribution, it is always possible, and such in an infinite number of ways, 
to represent it with two independent factors, one of which can be chosen 
arbitrarily. 

For a trivariate distribution it is possible to associate to any con¬ 
gruence of curves in space three independent variables, one of them 
associated with the curves of the congruence, the other two being two 
independent variables which define the congruence. Those results 
apply to any number of variates, and permit representation of a distri¬ 
bution with any number of variates with the aid of an equal or any 
larger number of independent factors. It is in particular possible to 
generalize Spearman’s theory with common factors. 

3) The special case y = f(x^a) where the two independent factors 
are x and a, gives evidence of simple and useful elements such as the 
locus of the representative point of the median value of y conditioned 
by X, 

4) Linear factor analysis already raises problems with regard to 
adaptation to an observed sample by conditions of simplicity and 
optimum. These problems are the same in the generalized case, but the 
choice must be made among a much wider class of possible solutions. 
It is at any rate possible to represent by means of these methods, 
probability distributions where the variables, although dependent, are 
not correlated. 

5) The simplest generalization of linear factor analysis seems to be 
the bilinear case. A simple example is given for bivariate distributions. 



UNE NOUVELLE METHODE D*ANALYSE 
FAGTORIELLE 


par Pierre Delaporte 

Professeur a VJnstitut de Statiatique de VUniveraiU de Paria (France) 

Les divers caractferes biom^triques, physiologiques, psychologiques 
que Ton peut mesurer sur un meme individu sont statistiquement lies 
et de nombreux problfemes d’analyse des correlations qui existent entre 
ces caract^res ont 4te proposes. L’un des plus interessants parmi ces 
probl^mes, mais peut etre aussi le plus difficile de tous, consiste k re- 
chercher si les liaisons que Ton observe entre les divers caract^res 6tudi6s 
pourraient provenir d’une origine unique essentiellement liee k Tindividu 
et agissant sur tous les caract^res que Ton peut mesurer sur cet 
individu. 

Dfes 1904, C. Spearman [11],^ en examinant les coefficients de 
correlation obtenus entre plusieurs tests psychologiques, observait une 
hi6rarchie entre ces coefficients et, par des etudes successives, 6tait 
conduit a penser que tous ces resultats pourraient provenir d’une unique 
source de liaison, le facte^ir general commun k tous les caract^res que 
Ton peut observer sur un meme individu. 

Le resultat de la mesure.d’un caract^re est ainsi form6 d’unepartie 
provenant du facteur g^n^ral et d’une autre partie propre au caract^re 
choisi et aux erreurs commises de cette mesure. Spearman a d^signe 
cette seconde partie sous le nora de facteur specifique du caract^re. Les 
facteurs specifiques seront done par hypoth^so statistiquement ind6- 
pendants du facteur general. Les facteurs specifiques seront statistique¬ 
ment independants les uns des autres s’il s’agit de caract^res ou d’aptitudes 
enti^rement distincts les uns des autres. 

En fait il est generalement difficile d’avoir des caract^res entiferement 
distincts les uns des autres, par exemple deux tests cherchant a mesurer 
des aptitudes differentes ne pourront eviter compl^tement d’avoir, en 
plus du facteur general, une partie commune telle que la memoire ou 
la rapidite des r6actions. T1 en resulte que les tests ou caract^res 
choisis ne pourront se conformer entiferement aux hypotheses initiales 
de C. Spearman. L’ensemble des liaisons que Ton observe sur plusieurs 
caracteres necessitera radjonction au facteur general d’un ou de plusieurs 
facteurs de groupes, facteurs qui se superposent au facteur general mais 
qui s’adressent seulement k quelques uns des caractferes ou aptitudes 
mesur^s. 

* Les num6ros entre crochets renvoient k la bibliographie. 
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L. L. Thurstone a donn6 une importance bien plus grande k ces 
facteurs de groupes et leur a attribu6 un rdle analogue k celui du facteur 
g6n6ral de Spearman; pour Thurstone cependant il n’existe pas n6cessai- 
rement un facteur general mais seulement une superposition de facteurs, 
appel6s facteurs multiples. Le r^sultat de chaque test est ainsi form6 d’une 
partie imputable k plusieurs facteurs multiples et d’une autre partie, 
independante des facteurs multiples, sp^cihque du test et de I’erreur 
commise dans la mesure. 

Ces deux theories admettent en fait Texistence de plusieurs facteurs 
ind6pendants les uns des autres. / 

Nous adopterons les hypotheses suivantes: 

1 ^—la mesure de chaque caractfere peut s’exprimer par une function 
lin4aire du facteur general, de facteurs de groupes s’il y a lieu, et du 
facteur specifique du caract^re. 

2®—facteur general, facteurs de groupes et facteurs sp6cifiques sont 
tous statistiquement independants entre eux. 

Je vais montrer comment, en introduisant la Statistique Mathema- 
tique en Analyse Factorielle, il m*a et6 possible de mettre au point une 
m6thode permettant de: 

V —trouver, d’aprfes les observations, le nombrede facteurs de groupes 
et les caractires dans lesqiiels chacun d’eux entre. 

2®—estimer statistiquement les coefficients de correlation entre le fac¬ 
teur general, les facteurs de groupes et chacun des tests. 

Juger si les valeurs obtenues sont statistiquement significatives. 

Supposons que Ton mesure k caractferes 1, 2, i, k sur chacun 
des individus. 


La valeur jXj du caract^re i sur Findividu j peut etre exprimee sous 
la forme de variable normee lO;, = i 

J i O' 


oh E[Xi] est Fesp6rance mathematique de la valeur du caractere i dans 
la population cr^ est Fecart type des valeurs du caractere i dans la 
population. 


Designons par: 

le facteur general de Findividu j exprime en variable normee, 

jJB, jO, ... les facteurs de groupes de Findividu j exprime en variables 
normees, 

j^i le facteur specifique de Findividu j pour le caracthre i, exprime 
en variable normee. 
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La premifere hypothfese donne des relations de la forme suivante pour 
chaque individu j: 


( 1 ) 

avec 


~ ocifl + Pi jfi + 71 jC? + ••• + Ai jiS^i 

< = ai j(7 4- Pi + Yi jC' + ... + Ai j^i 

j(? + Py. + 7k jC' + ... + Aj£ jiS^k 


= ... =: E[x{\ = ... = E[Xy^ = 0 
^[6^] = = E[C] == ... = E[Si] = ... - E[S,] = ... =.jS7[6fk]-0 

(T^ = ... = CT^ = ... = =0‘Q = Cy|} = CF(.= .,. = a’y zzsO-g =...=:0’g =l 

Ilk Ilk 

Pour tout caractfere i ne necessitant pas Tintroduction des facteurs 
de groupes jB ou (7 ou ... les coefficients Pi ou 71 ou ... respectivement 
seront nuls par hypothfese. Les autres coefficients a, /?, 7 , ..., A sont des 
constantes k determiner pour chacun des caract^res. 

En designant par p le coefficient de correlation totale de la population, 
rhypoth^se 2 , sur Tindependance des facteurs entre eux, peut s’ecrire 
ainsi 

Pqb = Pgo = ... = PgSj= PbSj = = ... = 0 — 1, 2, ..., Aj) 

a = ^ ^ i', hf i = 1, 2f ..,i k) 

Le coefficient de correlation vrai entre 2 caract^res h et i est donne par: 


(2) — E[xi^, arj — ail A + 7h 7i + ••• 

Dans le cas particulier oil il n’existe pas de facteur de groupe, Spearman 
a etabli une des conditions necessaires pour qu’un ensemble de k carac- 
t^res soit representable par le schema 1 facteur general et k facteurs 
specifiques en se limitant aux moments-produits du premier Qfdre. 

En remarquant que: 

Phi = E\xx, aj] = a,i ai 

on en deduit que les coefficients de correlation p doivent verifier la condi¬ 
tion dite de nullite des Tetrades: 

Tghij == Pgh Pij — Pgi Phj =0 (g:z^h^i^3\ g, h, iyj = 1, ..., k) 

Cette condition necessaire est celle que doivent verifier les moments- 
produits du premier ordre 4 2 variables. II est evident que si Ton uti- 
lisait des moments-produits d’ordres sup^rieurs on obtiendrait d’autres 
conditions n 6 cessaires. Garnett a montre [9] que si Tensemble des k 
caract^res 6 tait distribu^ selon une loi de Laplace-Gauss h k 
y^piables, la nullite de I’ensepable des tetrades 6 tait la condition 
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necessaire et sufiisante pour que I’ensemble des oaraot^res puisse etre 
repr6sent6 par un facteur g6ii6ral et k facteurs sp6cifiques independants. 

Enfin G. Darmois [1 et 2] en utilisant la fonction caract6ristique 
de Tensemble des variables, a montre que si les h caractferes 6taient 
distribues selon une loi de Laplace-Gauss k k variables la decomposi¬ 
tion en 1 facteur general et k facteurs sp6cifique8 etait unique. 

Pour conserver les deux propriet^s donn6es par Garnett et Darmois 
il faudra done transformer la distribution k etudier en distribution gaussi- 
enne 4 k variables; ce qu’on obtiendra pratiquement en transformant 
en distribution gaussienne chacune des distributions des caractferes qui 
s’en eloignerait fortement. 

1. LE PROBLEMfC STATI8TIQUE 

En fait le probl&me k resoudre n’est pas de Calcul de Probabilit6s 
mais de Statistique: on ne connait pas I’ensemble de la population mais 
seulement un ediantillon de n individus suppose preleve au hasard dans 
une population inconnue. En outre on ne dispose pas des valeurs r6eiles 
des caractferes, mais seulement de mesures entach^es d’erreurs. 

D6signons par r les coefficients de correlation empiriques. Formons 
les tetrades empiriques 

^Bhij = ^ij — ^hj (g j; g, h, i,j =- 1, k) 

Les tetrades t ne sont pas numeriquement nulles et on doit chercher 
si la valeur de t est statistiquement compatible avec Thypothese r = 0, 
la valeur observee etant alors attribuee aux erreurs d’cchantillonnage. 

Bien que K, Pearson [ 10 ] ait montre que la loi de distribution 
de t est theoriquement et pratiquement differente de la loi de Laplace- 
Gauss, on forme habituellement le rapport et on le compare k 
la loi de Laplace-Gauss. Ce precede est trfes long car pour 20 variables, 
par exemple, il necessite le calcul de 14,535 tetrades et ecart types cr^; 
le jugement du resultat reste difficile au point de vue statistique. 

Si certaines tetrades empiriques ne peuvent etre statistiquement consi- 
derees comme nulles, le schema de Spearman n’est pas applicable 
et il faut introduire un ou plusieurs facteurs de groupes. La recherche 
des caracteres qui necessitent un facteur de groupe pour representer les 
correlations observees est pratiquement impossible k faire d’apr^s les 
tetrades. 

2. NoUVELIiB METHODS DB BECHEBOHB DE LA FOSITION DES 
FACTBUBS DB GBOUPE8 

D’apr^s rhypothise de I’existence d’un facteur general, sans facteur 
de groupe, le critire de nuUite des tetrades 

Tgj„, = 0 peut s’6crire f>gj = pgj p^j 
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ou encore 

= ^.‘*J = 

Phj Phi ai. aj an“h 
d’une mani^re g^nerale 

(3) E^J = ?5l = ... — fli = = ... ^5!' = “« (i, j g, h)i 

Phi Ph2 Phi Phj Phk «h 

ainsi une seiile suite d’^galites resume C \^2 tetrades et fait intervenir 
2k—4 coefficients de corr61ation differents. 

Si Ton forme les k—1 relations du type precedent construites sur la 
base du caractfere h et egales a: 

Ofj, ftji ftj, aj, 

on fait intervenir au moins 2 fois chaciyi dos coefficients de correlation f). 

Si Ton remplace les coefficients de correlation p de la population par 
les coefficients de correlation r observes sur un echantillon de n indivi- 
dus les quotients de coefficients do correlation ne verifient plus exacte- 
ment les egalites (3). 

II faut done rechercher si, en tenant compte des erreurs d’cchantil- 
lonnagc, les quotients formes dos r empiriques verifient statistiquement 
la relation (3) avec une probabilite P qu’on sc donnera h, Tavauce. 

3. LOI DE DISTRIBUTION DKS RAPPORTS 

Si les caracteres ctudies sont distribues selon une loi do Laplace- 
Gauss, le nombre n des individus mesures doit etre necessairement 
grand (plusieurs centaines) pour que I’analysc factorielle puisse donner 
des resultats statistiquement interessants.® Si le coefficient de corre¬ 
lation de la population p n’est voisin ni de +1, ni — 1, r est approxi- 
mativement distribu6 selon une loi de Laplace-Gauss telle que: 

E[r] = P (l - l—P* + ... ) 



On obtiendrait une approximation meilleure [4] valable jusqu’4 p = ±1 
et pour des nombres n petits, en utilisant les covariances ygh au lieu des 

* Cette relation correspond a la proportionalite de 2 colonnes du tableau des 
coefficients de correlation qu’avait observ6e C. Spearman dans ses premiers 
travaux. 

• Voir au paragraphe 6 I’erreur type des estimations des coefficients nr, /?, 7,... 
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coefficients de correlation Pgh qui remplacent la relation (3) des rapports 
des coefficients de correlation par 

(4) (f, j gf, k) 

rhi yh2 yhi ynj yhk «h 

On pent montrer que la loi de distribution d’un rapport = Cf.ilChi 

des covariances empiriques est donne par 




_1 

TT 




4>^iT,,^—2p^<rgtr^+<Tg^ 


-i __ 

1 2p^a,<Fh+ff,.* yh<»'ggh [—^yV+p(^+y) gK«^i. —1 

‘ ' (^*v-2>0«^>h+v)*'* 

'\/27r 

oil yg et yh representent respectivement les covariances y^i et yhi, et o^i, 
designent les erreurs types^ des covariances: 

»^8 = '^XB‘^X,V'(l+PBt)/» ‘^1. = V(l + Pht)/« 

P = Pcg, c^j = (Pgh + pgi Phi)/v'(T'+ P^gOllT p\i) et »> = y^i/yhi 

Les courbes representatives de la density de probabilite ont des for¬ 
mes trfes varices selon les valeurs des paramfetres: 



2 d\ 


1 


d4 




Fig. 1 

Cette densite de probabilite permet de determiner leslimites entre 
lesquelles ^ doit se trouver avec une quasi certitude P de jugement don- 
n6e k Tavance. 

* Erreur type =* ^art type de l’err4ur d’^hantiUoimage, 
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Un cas particuUer tr^s fr i:ent dans les applications est celui oix 


Ti' 




Pm 

•\/l + P*hl 


est grand, alors le premier terme de la density de probability est trfes 
voisin de zero, Tintegrale qui figure dans le deuxiime terme est trhs voi- 
sine de 1 et, en ]:osant: 


—_Vii (0 y) __ 

la probability elementaire pent se mettre sous la forme 
M) ^ e 2 iw 

done, si a la quasi certitude P il correspond un ycart w d’apr^s la loi 
de Laplace-Gauss, les limites de confiance de ^ sont donnees par 

' ^ ~ o\ - y\ 

Ainsi, chacun des rapports (7^1/Gm permet de dyterminer Tintervalle 
dans lequel doit se trouver, avec la probability P, la quantity h estimer 
^ous ces intervalles ont une partie commune, la re¬ 
lation d’egality des rapports des covariances (4) est statistiquement 
vyrifiee, et si toutes les relations analogues obtenues en faisant varier 
g et hie sont aussi, toutes les ty trades sont statistiquement nulles. On 
peut alors admettre que Tensemble des correlations qui existent entre 
les caracteres 1, 2, ..., k est explicable par la seule presence d'un fac- 
teur gyneral. 


4. Approximation de la loi de distrirotion des rapports pour 
LES APPLICATIONS PRATIQUES [5] 

Dans les applications k des donnyes experimentales, j ’ai cherche a 
Bupprimer tout calcul numyrique pour dyterminer les intervalles com- 
muns ci-dessus. Pour limiter la dimension des abaques k construire, 
j’ai utilisy Tygality (3) des rapports de coefficients de corryiation au lieu 
de celle de covariances. 

Examinons successivement ce que devient I’ygality (3) pour des me- 
sures entachyes d’erreurs, comment construire les abaques et les gra- 
phiques d’intervalles communs. 
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4~1. Effet des erreurs de mesure sur le critire 

Si les mesures des caractferes sont eniachees d’erreurs ind^pendantes 
entre elles et ind6pendantes de la grandeur du caraot^re 4 mesurer, on 
peut montrer que les suites d’^galites (3) des rapports de coefficients de 
correlation existent encore pour les coefficients att6nu6s. 

4-2. Construction des abaques donnant les intervalles 
d'echantillonruzge des rapports r^Jr^^^ 

Si nous negligeons la correlation qui existe entre (^gi—Pgi) et (^hi— 
on peut, pour un nombre donne n d’individus de Techantillon, former 
un abaque donnant les limites de I’intervalle d'echantillonnage que peut 



atteindre le rapport r^ijr^^^ lorsque chacun des coefficients de correlation 
empirique prend toutes les valeurs possibles autour de et Phi ^vec 
une quasi certitude donnee P. 






dsLapobtIs 


Pour former nos abaques, nous avons utilise la quasi-certitude P = 
0.90, c’est-a.-dire que si jp(r/ii, p) indique la densite de probability d’ob- 
tenir un coefficient de corryiation r dans un ychantillon de n individus 
pryiev^s au hasard dans une population distribute suivant une loi de 
Laplace-Gauss k 2 variables de coefficient de correlation p on a: 

(5) j ^^ p(r\n, p) dr = 0.05 et |p(r|w, p) dr = 0.05 

Les abaques construits pour n = 100 et n = 200 ont ttt obtenus au 
moyen des tables de F. N. D a v i d [3]. Les abaques relatifs k 
n — 300, n = 500 et n = 1000 ont ett obtenus au moyen de la trans¬ 
formation de R. A. Fisher qui donne pour valeurs limites Z** et 
de r 

(6) L' = tgh( arg tgh p + —et P = tgh ( arg tgh p — — 

V etant un ecart tel que, d’aprts la loi de Laplace-Gauss reduite, la 
probability d'observer un ecart inftrieur a v soit la quasi-certitude 
utiliste P = 0,9. 

Des relations (5) ou (6) on tire la forme reciproque donnant les va¬ 
leurs limites de p acceptables pour une valeur observte r et on construit 
Tabaque donnant les limites entre lesquelles doit se trouver ofg/ah d’aprfes 
la valeur de observee. 

Les intervalles lus sur Tabaque sont tels que, d’aprfes la relation (2) 
chacun des intervalles relatifs k rgi/r„i a une probability comprise entre 
0.01 et 0.1 de contenir ag/a,,, cette probability etant 0.01 si Pr^, r^i = ^ 

eto.l si pr^. rj, = 1- 


4-3. Les graphiques d"intervalles communs 

Formons un graphique en portant en ordonnee les valeurs de Pgi/phi 
lues sur I’abaque, qui varient de — <» 4 + oo, avec une echelle permettant 
une representation pratique de Tensemble des valeurs et en prenant 
en abscisse successivement les divers caractyres (i = 1,2, i g,h). 

Pour chaque i on trace le ou les intervalles entre lesquels doit se trou¬ 
ver le rapport pgi/Pn et on cherche s’ils ont une partie commune ou quels 
sont les caractyres pour lesquels il faut yiiminer les rapports r^^jr^,^ pour 
que les autres aient une partie commune. Cette partie commune 
(figurye par des lignes en pointiliy) limite le domaine dans lequel aja^ 
doit se trouver. 
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On forme, les uns & cdt4 des autres, la s^rie des ib—1 diagrammes ana¬ 
logues en h estimant 

5 ? . .... “1 . .... 

«h «h “h “h «h 


puis la s^rie des k—l diagrammes relatifs & un autre caracti*rej 


?8 , .... “L. ?!5 

Ofj Ojj ttj fltj Olj 



Par Tensemble de ces diagrammes, on recherche chacun des coeffi¬ 
cients de correlation qu’il faut eiiminer pour que Tensemble des autres 
donne des intervalles ayant toujours une partie commune et soit done 
representable par un facteur general; les autres necessiteront Fintro- 
duction de facteurs de groupes. 

Remarquons que s’il existe un intervalle commun a tous les k~2 car- 
acteres de chaque diagramme, la nuliite de I’ensemble des tetrades est 
statistiquement verifiee et les k caractferes sont representables par le 
schema de Spearman avec un facteur general et des facteurs speci- 
fiques, sans facteur de groupe. Ainsi pour 20 caractires qui fournissai- 
ent 14,535 tetrades It calculer et dont il fallait examiner statistiquement 
la nuliite, il suffit, par ce nouveau precede, de lire sur Tabaque les limites 
de confiance de 684 rapports et d’en construite le graphique pour re* 
soudre le problfeme. 
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D’autre part, si Ton constate qu’une tetrade ne pent statistiquement 
etre consider6e comme nulle, il faut rechercher parmi les 4 caractferes 
qu’elle introduit lequel ou lesquels doivent etre elimines. Au contraire 
le precede des intervalles communs que nous proposons ne pent laisser 
d’hesitation que sur 3 caractferes et le plus souvent le caractfere k elimi- 
ner est celui qui intervient simultanement au num^rateur et au deno- 
minateur. 

La simplification ainsi apportee permet de faire un depouillement 
sous forme de tableau k double entree des coefficients de correlation pour 
lesquels il y a doute et de determiner ainsi la position et le nombre des 
facteurs de groupes sans aucun calcul prealable. Les autres methodes 
de localisation des facteurs de groupes proposees jusqu’a present ne 
peuvent atteindro ce resultat que par des approximations successives 
demontree. 


6. Estimation du coefficient de corb^dation bntre un cabactbhe 
ET LE FACTBUR Ol^N^RAL 

D’apres les hypotheses de Spearman, les coefficients du 

systeme (1) sont les coefficients de correlation Pio, Pko entre les 
caractferes 1, & et le facteur general G. On pent les obtenir au moyen 

de la relation 

(7) P^lG = _ P (k- l)h Puh. 

Pl2 PlZ Pik-Vk 

Les divers termes de cette relation ne sont plus egaux lorsqu’on rem- 
place les coefficients de correlation theoriques p par leurs valeurs r ob- 
servees sur rechantillon. Pour obtenir une meilleure estimation que 
celle donnee par un seul des termes de la suite d’egalites (7), Spearman [12] 
a propose de prendre la somme des numerateurs divisee par la somme 
des denominateurs: 

p2 = Plh p 2 h + P ih Pz h + ••• + P ik-Dh Pkh 
Pl2 + Pl3 + -•• + P(k-Vk 

L’estimation r,jo de p^q que Ton obtient en rempla9ant les coefficients 
de correlation p par leurs valeurs observees r ne tient pas compte de la 
loi de probability de Terreur d’ychantillonnage des coefficients de corre¬ 
lation observes. On peut obtenir des resultats beaucoup plus precis 
en prenant pour estimation de p\g If*- moyenne ponder^e des divers ter¬ 
mes de la relation (7) ayant Vecart type minimum. Si Ton d^signe par 

I’erreur type de cette estimation est donnee par 

Tti 


r^ba 




(h ^ i ^ iyj — !>•••» 
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En supposant que les k caract^res sent distribu6s selon une loi do 
Laplace-Gauss k k variables, nous avons montr6 [7] que Testimation 
de Pho Byant F^cart t 3 q)e minimum, 6tait donn^e par 


( 8 ) 


r\Q 




oil 

(9) (»*,h+«*jh+«V t)*jh)(l+3«^,)+5v«.j + ... ] 

Pii 

I _y2 

Vih = — —— — coefficient de variation de rih* 

Vb— l.rjH 

Si les caractferes ne sont li6s que par un facteur general, les sommes 
X de la formule (8) sont 6tendues k tous les i(fc-~l)(fc—2) couples de 

caract^res ij ne comprenant pas h, 

* » 

S’il existe des facteurs de groupes, les sommes S ne devront etre 

6tendues qu’aux couples ij tels qu’aucun des Pih> Pjh» Pij ne fasse inter- 
venir de facteur de groupe. 

Remarquons que les valeurs de W varient tr4s fortement et donnent 
parfois k certains termes de la moyenne ponder6e (8) des poids 1,000,000 
de fois plus faibles qu’it d’autres termes. 


6. Loi de distribution de l’estimation du coefficient de cobb^ation 

ENTBE UN CABACTEBE ET liE FACTEUR G^N^BAL 

L’estimation r^o donn^e par la formule (8) est obtenue au moyen d’une 
moyenne arithm^tique ponder^e, done la loi de distribution de r^o autour 
de PhG tend vers une loi de Laplace-Gauss lorsque le nombre des termes 

de X est grand, 
ill 

L’erreur type de cette distribution est donnee par: 



les sommes X ^tant 6tendues aux m£me couples de caractfcres que les X 
hi hi 

de la formule (8) qui a servi k faire I’estimation rao, w 
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Notoiis que restimation rho du coefficient de correlation Pho ^tant dis¬ 
tribute selon une loi de Laplace-Gauss autour de Pho, on pourra obtenir 
parfois des valeurs |rhG| > 1. 

7. Estimation et loi de distribution du coeppicient de correlation 

BNTRE UN CARACTBRB ET CHACUN DES FACTEURS DE OROUPES 

La formule (8) permet d’obtenir des estimations == des coeffi¬ 
cients pijc = oTh du facteur gentral dans le systtme (1). Par la relation 
(2) on obtiendra les premitres correlations rtsiduelles 

P hi = Phi — <*h<*i = fih + yiiVl + ••• 
estimees par r'^i = ^hi—«h«i : Les couples hi de caracttres n’admettant 
pas de facteur de groupe entre eux doivent donner les premiers residue 
r'hi statistiquement nuls. Pour les couples de caracttres ayant 1 ou 
plusieurs facteurs de groupes entre eux, on analysera les residus r\i de la 
meme manitre qu’on avait analyse precedemment les coefficients de cor¬ 
relation Thi observes. Pour cela on considerera le premier facteur de 
groupe comme le facteur general des et les autres facteurs de groupes 
comme on avait prectdemment considere Tensemble des facteurs de 
groupes. Les methodes d’estimation des coefficients seront les memes, 
mais on remplacera dans la formule (9) W par W' et i;,h par 
«^'ih = oh 

0 - 2 , = 0-2 _|_^2 r?G+(rl <rf avec cr^ = — 

ih ill iiO jo iO hG 


Les formules (8) ct (10) deviendront respectivement pour le facteur 
de groupe B 


( 11 ) 


r2 

'liB 


r ^_'ih ^'jh 

WU 



(h ^ i =^j) 


( 12 ) 



PbB 



) 




les sommes % sont elendues k tons les couples ij introduisant le premier 
h\ 

facteur de groupes suivants. 

La loi de distribution de rho tend vers une loi de Laplace-Gauss pour 
les memes raisons que celle de 


» La valeur de donnEe par cette formule est un peu trop forte car les erreurs 
d’tchantillonnage de rih* rio et fho ne sont pas indtpendantes, toutes ces valeurs 
ayant ^t^ dEtepninEes au moyen du m6ms Echantillou, 



254 


INTERNATIONAL STATISTICAL CONFERENCES; I S I 


8. VtoFICATlON DE L^EFFICACIT^ DE LA M^THODB 

Une des principales qualit^s que doit presenter une methode d’analyse 
factorielle est que, si un ensemble de caractferes est reellement lie par 
une combinaison lineaire de facteurs independants, cette methode doit 
permettre de retrouver le schema de liaison et chacun des facteurs, et 
non pas d’autres schemas et d’autres facteurs, meme si les mesures des 
caractires sont entachees d’erreurs. 

D. Weinberg [13 et 14] Directeur-Adjoint du Laboratoire de 
Biometrie Humaine desirait qu’un tel controle des methodes d'ana- 
lyse factorielle fut fait et a organise un schema de 12 caracteres 1, 2 ,..., 
12 provenant d’un facteur general de 3 facteurs de groupos B, C, 
Z>, et de 12 facteurs specifiques 8^^ ...^8^^. Ensuite on a constitue 
artificiellement les r6sultats des mesures de 300 individus en determi¬ 
nant pour chaque individu les 16 facteurs par le jet dc des a jouer. Ces 
resultats ont ete composes selon le schema pour former les individus 
hctifs qui ont servi k calculer les 66 coefficients de correlation. 

Ces coefficient de correlation m’ont ete remis par D. Weinberg 
sans aucune indication sur le nombre des facteurs ou sur la forme du 
schema. J’ai utilise la methode ci-dessus pour analyser les coefficients 
de correlation. L’etude des intervalles communs m’a permis dc retrou¬ 
ver exactement le schema k un facteur general et 3 facteurs de groupes 
qui avait 6te utilise. Une premifcre approximation [6] des coefficients 
de correlation entre caracteres et facteurs nous a donne des resultats 
voisins des coefficients theoriques de D. Weinberg (nous n'avions 
pas encore trouve k ce moment I’estimation rijo k ecart type minimum). 
Void les coefficients theoriques de correlation entre caractferes et fac¬ 
teurs, leurs estimations et les erreurs types de ces estimations calculees 
par les formules (8), (10), (11), et (12). 


fac¬ 

teurs 

Coefficients theoriques 

Coefficients estitnes 

erreurs types 

0 

B 

C 

D 

O 

B 

C 

D 

G 

B 

C 

D 

1 

.677 

.677 

_ 

_ 

.672 

.593 

_ 

_ 

.034 

.062 

_ 

_ 

2 

.236 

.943 

— 

— 

.271 

.918 

— " 

__ 

.034 

.204 

— 

— 

3 

.943 

.236 

— 

— 

.939 

.230 


— 

.016 

.053 

_ 


4 

.436 

.873 

— 

— 

.480 

.868 

— 

— 

.032 

.092 

— 

— 

5 

.677 

— 

.677 


.600 

— 

.607 


‘.036 

— 

.118 

_ 

6 

.236 

— 

.943 

— 

.206 

— 

.964 

_ 

.060 

— 

.192 


7 

.918 


.229 

.229 

.906 

— 

.243 

.233 

.024 

— 

.110 

.106 

8 

.707 

— 

.471 

.471 

.660 

— 

.626 

.664 

.046 

— 

.106 

.183 

9 

.943 

— 

— 

.236 

.941 

— 

. — 

.220 

.020 

— 


.096 

10 

.236 

— 

— 

.943 

.223 

— 

— 

.778 

.060 

— 

— 

.378 

11 

.949 

— 

—. 


.951 

— 

— ■ 

— 

.016 

— 

_ 

— 

12 , 

.316 

— 

— 

— j 

.365 



— 

.020 
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L’es estimations des coefficients de correlation entre caracteres et fac- 
teurs etant di8tribu6es autour des coefficients th6oriques selon des lois 
de Laplace-Gauss, on pent tester pour le facteur general I’accord statis- 
tique entre valeurs theoriques et estimations pjir 

X® = S Ur^o-PiofK - 15.3 

i-1 lO 

avec 12 degres de liberte, ce qui correspond a une probabilite de 0.23 
d’obtenir un accord moins bon. Ce resultat pent etre considere comme 
excellent. 

Diverses applications de cette methode a des donnees experimentales 
ont 6te publiees [8]. 


Conclusion 

L’introduction de la Statistique Mathematique en Analyse Factor! • 
elle nous a permis de donner a celle-ci une forme tenant compte k tout 
moment de ce qu’elle analyse des donnees experimentales, obtenues 
avec des erreurs de mesures sur des individus, et non pas des donnees 
mathematiqiies. La construction des graphiques des intervalles com- 
muns nous a donne une forme materiellement beaucoup plus simple 
que les tetrades pour reperer I’existence et localise! la position des fac- 
teurs de groupes. Nous avons enfin obtenu une estimation beaucoup 
plus precise du coefficient de correlation entre caractere et facteur. 
L’usage de cette estimation k ecart type minimum, nous a permis de con- 
naitre la distribution et Terreur type de Cette estimation; ce qui per- 
mettra a ceux qui utilisent TAnalyse Factorielle de connaitre les varia¬ 
tions de resultats qu’ils peuvent trouver d’un echantillon a un autre 
preleve dans une meme population, et done d’interpreter avec plus de 
securite les resultats donnes par le calcul. Nous pensons que perfec- 
tionner ainsi Toutil qu’est Tanalyse factorielle permettra son emploi 
dans un grand nombre de probltmes de biometrie, de meteorologie, d’hy- 
drologie, ou d’econometrie, de meme que dans certaines fabrications 
industrielles, etc. ou I’analyse de I’ensemble des caracteres mesures 
semble actuellement ne pouvoir se faire utilement quo par une de¬ 
composition en facteurs independants. 
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R^sum^ 

The object of this paper is to show how by introduction of mathema¬ 
tical statistical methods it is possible to obtain a very large extension 
of factor analysis, first introduced by C. S p e a r m a n. It is assumed 
that the measurements of each variable can be explained by a linear 
function of a general factor G, of group factors, if necessary, and of the 
specific factor of the variable, and further that all these factors are sta¬ 
tistically independant. By studying the sampling distribution of ratios 
of observed correlation coefficients, a confidence interval is determined 
for each ratio and for a given level of probability. This interval is ob¬ 
tained without computation on the chart of paragraph 4-2. The gra¬ 
phical interpretation of confidence intervals gives common interval gra¬ 
phics (par. 4-3) which are used instead of the classical tetrad differen¬ 
ces test. These common interval graphics show which correlations 
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can be explained by a general factor only and also the correlations for 
which the introduction of group factors is necessary. 

The next step is the estimation of the correlation coefficient between 
each variable and the general factor, obtained by a weighted arithme¬ 
tical average with minimum variance of the sampling error (formula 8). 
The standard error (formula 10) and the sampling distribution of the es¬ 
timate are calculated. This distribution is shown to be a normal law 
when the number of characters is large enough. These methods are 
generalized in order to obtain the corresponding results for group fac¬ 
tors and to estimate the correlation coefficient between a character and 
each of the group factors. 

Finally an experimental verification is given in order to show the 
efficiency of the author’s method of factor analysis. From the ob¬ 
served correlation coefficients among 12 variables it has been possible 
to find out exactly, without any information about the scheme used 
in getting the data, that the true correlation had been caused by one 
general factor and 3 group factors. Correlation coefficients between 
variables and factors have been estimated and the test has been app¬ 
lied, the whole group of errors of estimation has been shown to be in 
agreement with the computed standard errors. 
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THE MEANS OF SAMPLES 


by Corrado Qini 
University of Rome (Italy) 

While much has been written on the influence of the limited number 
of observations on the value of indices of variability and relation, its 
influence on means, so far as I know, has never been studied. This pro¬ 
bably depends on the fact that the expected value of the arithmetic 
mean—which is the one usually considered—of the sample, evidently 
coincides with the value of the mean of the collective phenomenon from 
which the sample is drawn. 

But what of the other means ? The question may have been discussed 
without my knowledge. Indeed, statistical literature has now taken 
such vast proportions that no one can presume to be acquainted with it 
alL So large is it indeed, that when the problem is a simple one, as in 
the present case, it takes less time to solve it than to find out whether 
it has been solved elsewhere. 


t 

Let us define first of all what we mean by “sample.” A sample is a 
group of elements selected at random from the mass or collection of ele¬ 
ments that compose the collective or mass phenomenon. Some call 
this mass “population,” some “parent population,” and some “universe.” 

The two first expressions call to mind demographic phenomena or 
phenomena allied thereto. The last calls to mind the idea of the infinite 
and is therefore advisable only when the number of elements entering 
into the collective phenomenon may be supposed, by abstraction, to be 
infinite. But when the sample is taken from a positive mass of elements, 
necessarily finite in number, the word “mass” seems to me preferable, 
and I shall adhere to it. 

The random selection of the sample may be made in several ways. 
Each element selected may be returned to the mass before the selection 
of another, or it may be kept separate from it. In the first case, we 
speak of random selection tvith repUicement\ and in the latter of random 
selection ivithout replacement, meaning thereby “replacement of the selec¬ 
ted element.” But the entire sample whose elements are selected with¬ 
out replacement may, when it has been completed, either be or not be 
returned to the mass before another sample is drawn. We shall there¬ 
fore speak of '‘replacement (or non-replacement) of the sample.” 

When we speak of ‘^a sample Elected at random,” reference is gener¬ 
ally made to a selection made by chance without replacement of the 
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elements, but with replacement of the sample, and in this note we also 
will use the expression in that sense. In any case, in the problem we 
are discussing, the conclusions would not vary, as may be readily un¬ 
derstood, even supposing the selection were made with replacement of 
the elements, or with non-replacement of sample as well as elements. 


11 

I shall limit my study to the firm basal monoplanar means, i.e., to 
those in which the elements from which the mean is drawn are all pre¬ 
sent, and all as bases, and only in the numerator. The most compre¬ 
hensive formula so far proposed for firm basal monoplanar means is that 
of the combinatorial power mean : 


( 1 ) 


hMP 


»/■,«) 


in which m is the number of the elements of the mass, Uj (i = 1,2, ..., m) 
a generic element of the mass; p any real exponent to which the m ele¬ 
ments of the mass are raised; the number of the. combinations of 

the m elements 6 by 6, while S as usual indicates the sum of the terms 
and P\ the product of the h elements in the combination. 

If 6 = tiie combinatorial power mean is reduced to the geometric 
mean ; if 6 = 1, it is reduced to the power mean given by the well-known 
formula: 



If p = 1, the combinatorial power mean is reduced to the formula, also 
well known, of the combinatorial mean^ 



Two combinatorial power means are described as homograde when the 
product bp in them is equal, and are described as bihomograde when both 
b and p are equal. All the bihomograde means are therefore homograde, 


* See, for all this, the article,“Pi una formula comprensiva delle medie,!* Metron, 
vol. 13 (1938). 
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but there are some homograde means that are not bihomograde. Thus 
two biquadratic means (in which 6 = 1, = 4) are bihomograde (and 

therefore also homograde), as two combinatorial power means in which 
the terms raised to the second power are taken 4 by 4 (therefore 6 = 4, 
= 2) are bihomograde. On the other hand, a biquadratic mean and 
a combinatorial mean whose terms are taken 4 by 4, and again a combi¬ 
natorial nlean whose terms raised to the square are taken 2 by 2, are 
homograde (in all three cases bp = 4) but not bihomograde. 

To determine the relations between the expected value of a certain 
mean of the sample and the value of the homograde or bihomograde 
mean of the mass, I will state four lemmas of which some have already 
been demonstrated while others can easily be demonstrated. 

Lemma 1: The value of a power mean for positive values of the 
terms ai increases with the exponent p.^ 

The geometric mean is, as is known, intermediate between the arith¬ 
metic and harmonic, and this is in keeping with the fact that, for p tending 
to zero, the power mean tends toward the geometric mean. Therefore 
the geometric mean may be indicated by the symbol 
The following inequalities can therefore be established: 

(4) ... < M-^ <M^ <M^ <M^ <M^ ... 

which show us that the biquadratic mean is larger than the cubic which 
is larger than the quadratic, and this than the arithmetic, and this than 
the geometric, and this than the harmonic, and this than the biharmonic. 

Lemma 2: A power mean of the mass is equal to the homograde mean 
of the means {all being homograde as regards one another) of all the possible 
samples which may be drawn from the mass. 

One may draw from a mass of m elements different samples, each 

with s elements. If we indicate by mM'P the power mean of degree 
p of the mass, by the power mean of degree p of a sample of the 
said mass (in which 5 = 1, 2, 3, 1)» and by f^^e power 

mean of degree p of the|^J means the lemma tells us that^ 

( 5 ) . * 

» This has been demonstrated by O. Dunkel, “Generalized Geometric Means 
and Algebraic Equations,” AnnaU of Mathematics, 1909. 

. • Professor G. Usai has demonstrated this for the special cases of arithmetic, 
harmonic, and quadratic means. See G. Usai, “Alcune considerazioni sulle medie,” 
BoUettino delVAccademia Oioenia, Catania, 1940; “Propriety eombinatoria di certe 
medie— Eaercitazioni matematiche, publications of the **Circolo matematico di 
Catania,” Vol. 12 (1940). For another demonstration, see G. Pompilj, “Sulla 
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Let us express this relation by saying that the power mean is transit 
live 08 related to the sample.^ 

Lemma 3 ; The geometric mean of the mass is equal to the geometric 
mean of the geometric means of all the possible samples that can be drawn 
from the mass. 

That is to say® 

(6) 


This property was to be expected because the geometric mean is the 
limit of the power mean in the special case where p — 0. 

Therefore the geometric mean is also transitive as related to the sample. 

Lemma 4: A combinatorial power mean of the mass is equal to the 
homograde power mean of the combinatorial power means (which are bihomo¬ 
grade as regards one another) of all the possible samples which may be drawn 
from the mass. 

Let be the combinatorial power mean of degree bp of the m ele¬ 

ments of the mass, raised each to the p power, and combined b by b; 
JlMf the combinatorial power mean of degree bp of a sample (in which 
s= 1,2, and the power mean of degree bp of the 



means of the samples. 


The lemma says® 


( 7 ) 




media geometrica o sopra un indice di mutabilita calcolato medianto un campionc —, 
'^Memorie della Societa Italiana delle SScienze, delta dei XL, Series III, Vol. 26. It 
was this communication submitted by Dr. Pompilj to the Seminary of the Institute 
of Statistics of the University of Rome (Faculty of Statistical, Demographic, and 
Actuarial Sciences) which suggested to me the present paper. 

The general demonstration is easy. From the definition of a sample it follows 
that each element of the mass has the same probability of being an element of the 
sample so that in the body of the possible (^)saraples each element of the mass 
will enter (g*) ^ times, times: now, if of the ) power means of 

degree p of all the possible samples we take the power mean of degree p, we shall 
obtain the power mean of degree p of the m elements of the mass, each of which 
is repeated (’JZi) times. Evidently, the value of this mean is the same as that 
of the power mean of degree p of the m elements, if each be taken once only, i.e., of 
the power mean of degree p of the mass. 

* It is commonly said that a mean is transitive when the moan of « means, each 
of n elements, is equal to the mean of the $n elements. 

® G. Usai, “Proprieta combinatoria di certe medie,” loc. cit., demonstrates this. 

® So far as I know, the demonstration has never been given. It is analogous 
to that given under note 3. Indeed, if of the combinatorial power mean of 
decree bp relating to all the possible samples the power mean of degree bp bo made. 
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It should be noted that the lemma says “it is equal to'the homograde 
power mean,” and not “it is equal to the bihomograde combinatorial 
power mean.” Therefore, the combinatorial power means are not transi¬ 
tive as related to the sample. 

Let us remember that the expected value of a certain mean of the 
samples which we will indicate by for the power means, and 

for the combinatorial power means, is nothing but the arithmetic 
mean of the means, homograde or respectively bihomograde as regards 
one another, of all the possible samples which may be drawn from the 
mass. We might therefore write 

(8) EUMP) = 

(9) E(^MP) = SOl'CiM?) 

Now, from Lemma 1 we obtain 

< 

< 

m-HmMf) < m-HmJHf) < < 

< < mnM) 

and therefore, from (5), (6), and (8), 

E(M = 

for the arithmetic mean, i,e., for p = 1; 

( 10 ) EUM^,) > 

for the geometric and harmonic means and in general for all those for 
which p < 1; 

( 11 ) EUM^.) < mMP 

we shall obtain a new combinatorial power mean of degree hp which includes )(ft) 
combinations, each formed of 6 elements €uid in eiwjh of which every element of the 
mass has the probability of appearing \ ^ m * combinatorial power 

mean has indeed the same value as the combinatorial power mean of degree hp of 
the mass which includes combinations each formed of 6 elements and in each 
of which every element of the mass has the probability - of appearing. Indeed 
the two means only differ in their composition owing to the fact that each of th^ 
combinations that appeers in the second is repeated in the first; 

(7) (?): (7) “ (s:$) 
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for the quadratic, cubic, and biquadratic means and, generally speaking, 
for all those for which 3 ? > 1; and from (7) and (9), 

for p = lib; 

( 12 ) for/.<l/ 6 ; and 

(13) EaM^,)<i,MP fori)>l/ 6 and 

more especially for ^ = 1 , in which last case we have the combinatorial 
power mean. 

As is seen, it is only in special cases, i.e., only for the power means 
or for the combinatorial power means,of degree one, that the expected valvs 
of the sample mean is equal to the expected value of the homograde mean of 
the mass. In the other cases it is larger for some means and smaller for 
others. To bo precise, the expected value of the sample mean is larger 
for all the* power means or combinatorial power means of degree lower 
than one, and smaller for all those of degree higher than one. 

As the value of the power means or combinatorial power means in¬ 
creases with the value of the exponent p, it follows that with the variation 
of the exponent p, the power mean or combinatorial power mean of 
the sample varies, less than that of the mass. This conclusion helps 
to solve a practical point that was called to my attention, in rela¬ 
tion to the compilation of price index numbers. 

Many writers, after having calculated the price index numbers for 
individual commodities prefer, in order to obtain therefrom the average 
index number of prices of said commodities, to calculate the geometric 
rather than the arithmetic mean of the index numbers for the indivi¬ 
dual commodities. Now, suppose that the geometric means have thus 
been calculated for the individual commodities entering into the various 
groups of goods (as for instance, agricultural products, ores, semi-manu¬ 
factures, and finished products). Should the geometric mean or the 
arithmetic mean of these group index numbers be calculated in order to 
obtain a general price index number of the commodities belonging to 
{til the groups? The reply is: the geometric mean, inasmuch as it is 
the geometrtc mean of the group index numbers which gives the geo¬ 
metric mean of the index numbers of all the individual commodities 
belonging to all the groups. 


Ill 

The inequalities (10), (11), (12), and (13) are more marked the smaller 
the sample taken from the mass. This is easily understood when it is 
remembered that given a mass m and two samples s* and s'", for which 
8 * < s", s" may be considered as a mass in relation to s' so that, between 
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the means of s* and s" the difference occurs in the same direction as 
between the means of and m, and consequently the difference between 
the means of 8 * and m is equal in direction and greater in intensity than 
the difference between the means of and m. 

Similarly, one can understand that with the variation of the exponent 
p, the power mean or combinatorial power mean varies less, the smaller 
the sample. 


IV 

y 

The combinatorial power mean for b ^ m becomes equal to the 
geometric mean whatever p may be; for = 1 it becomes equal 

to the power mean whose value varies with the variations in the 
value of p. Therefore, in conformity with the principle of continuity, 
it is to be expected that the value , m being constant, will vary all 
the more with the variation of p, the smaller is b. 

V 

The combinatorial power mean of degree bp of a sample may be re¬ 
duced to a homograde power mean of the geometric means of the|^^ j 
samples, each formed of b elements, that may be drawn from the mass. 

It is indeed 

(14) ■ • m'-PUMt) 

Now the second term of the equation may be generalized by taking, 
instead of the geometric mean Jf®, and the power mean any two 
other means. The same result is obtained by generalizing (9) by re¬ 
placing the arithmetic mean by a combinatorial power mean. The 
expression thus obtained 

(16) 

expresses a true mean and supplies an expression of the firm basal 
monoplanar mean which is evidently more general than (1^ 

VI 

Let us check, by an example, the conclusions reached above. Take 
a mass of five terms: 1, 4, 5, 10, 80. 

Table I illustrates the differences between the power mean of the mass, 
and the expected value of the homograde power mean of the sample 
for 5 = 1, 2, 3, 4. As will be seen by running over the several 
columns, the arithmetic mean (by p = 1) of the mass (= 20), is equal to 
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the expected value of the arithmetic mean of the sample, whatever may 
be the number (1, 2, 3, 4) of elements it includes. 

For the quadratic, cubic, biquadratic means (p = 2, 3, 4) the expected 
value of the mean of the sample is found instead to be smaller than the 
homograde mean of the mass, and the inequality is all the greater the 
smaller the sample (for instance, for p — 3, we have 29.006 < 35.487 < 
41.648 < 46.820). On the other hand, for the geometric (p = 0), harmonic 
(p = —1), and biharmonic (p = —2) means, the expected value of the 
mean of the sample is found to be greater than the value of the homograde 
mean of the mass and the inequality is all the greater the smaller the 
sample (for instance, for p = ~2, we have 4.831 > 3.4 84 > 2.729 > 2.12). 

Table I also shows that, with the variation in the value of the ex¬ 
ponent p, the value of the power mean varies more in the mass than 
in the sample, and the smaller the sample the less it varies. Thus, 
when p passes from —2 to 4, the power mean varies in the mass from 
2.1 to 53.5; while in a sample of 4 elements its expected value varies from 
2.7 to 46.7, in one of 3 elements from 3.5 to 39.2, in one of two elements 
from 4.8 to 30.5, and finally it coincides always with the arithmetic 
mean in the extreme case in which the sample consists of one element 
only. 

Tables la, Ib, and Ic, show in detail the calculation of the expected 
value of the power mean of the sample in the respective cases 

s == 4:, s = 3, s — 2. 

Tables II and III illustrate the differences between the combinatorial 
power mean of the mass and the expected value of the bihomograde 
means of the samplei^(,J;ilfjO^«rm = 5, 6 = 2, and® = 4,3,and 2(TableII); 
and for m ~ 5, 6 = 3, and 5 = 4 and 3 (Table III). Both in Table II and 
in Table III the expected value of the mean of the sample is greater than 
the value of the mean of the mass for the geometric, harmonic, and 
biharmonic means, and smaller for all the others, including the arithme¬ 
tic mean, as 1/6 = ^ in Table II and 1/d — ^ in Table III, and 
therefore in both cases 0 < 1/6 < 1. 

It should also be noted that the inequalities increase as the number 
of elements in-the sample decreases. Thus, for instance, in Table II, 
for p = 2 and 6 = 2, we have 10.028 < 13.268 < 15.784 < 17.385, while 
for p = ~2 and 6 = 2, we have 10.028 > 4.396 > 3.598 > 3.132. 

Tables II and III also illustrate how, with the variation of the ex¬ 
ponent p the value of the combinatorial power mean varies more in the 
mass than in the sample and in the sample the less the smaller it is, until 
the said value of the combinatorial power mean becomes constant 
and equal to the geometric mean when the sample is equal to the number 
of elements entering into the combination. Thus for 6 = 3 (Table III) 
the value of ® passes, with the variation of p from —2 to 4, from 

34 
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3.8 to 13.5, while the value of E(%M%) for .9 = 4 passes from 4.5 to 
11.5 and for s — 3 remains always equal to 8.1. 

Tables Ila, Ilb, and Ilia show the details of the calculation of the 
expected value of the combinatorial pt.wer mean of the sample, respec¬ 
tively for 6 == 2 and s = 3, for 6 = 2 and .9 = 4, and for ^ = 3 and 
5 = 4 . 

Table IV‘ illustrates how the values that the combinatorial power 
mean of the mass acquires with the variations of p vary all the 
less the more b approaches m and at last become equal for b — m. Thus, 
as p passes from —2 to 4, the value of passes from 2.1 to 53.5 for 
6=1, from 3.1 to 21.4 for 6 = 2, from 3.8 to 13.5 for 6 = 3, from 4.6 
to 10.2 for 6 = 4, and remains constant at 6.931 for 6 = 5. 

Lastly Tables V and VI illustrate the similar relations between the 
expected value of the combinatorial power mean of the sample J) 

and the value of 6 in the case of samples of 4 and 3 elements. 

Table I 


Comparison between the values of and the respective values of 
for different values of p and s 


p 

-2 

-1 

0 

1 

2 

3 

4 

mM^ 

2.12 

3.2 

6 931 

20 

36.172 

46.820 

5,3.603 

E{niMP) for: 








« = 4 

2.729 

3.682 

7.:i61 

20 

33.467. 

41.648 

46,701 

« = 3 

3.484 

4.396 

8.146 

20 

29 998 

3,6.867 

39.200 

« = 2 

4.831 

5.869 

10.028 

20 

26.067 

29.006 

30.456 

s = 1 

___ 

20 

20 

20 

20 

20 

20 

20 


Table la; Various values of in nil the possible samples for m — 5, « ~ 4, 

and for different values of p, and their arithmetic mean E{^ 


Elements of 
the sample 

P 

— 2 

-1 

0 

1 

2 

3 

4 

1.4, 6, 10 

1.896 

2.681 

3.761. 

6 

6.959 

6.676 

7.222 

1, 4, 5, 80 

1.906 

2.736 

6.326 

22.5 

40.131 

50.263 

56.569 

1, 4. 10, 80 

1.931 

2.936 

7.521 

23.75 

40.363 

50.432 

66.672 

1, 6, 10, 80 

1.962 

3.048 

7.963 

24 

40.392 

60.434 

66.672 

4, 6,10, 80 

6.969 

7.111 

11.247 

24.76 

40.438 

50.436 

66.672 

S(iMf) 

2.729 

3.682 

7.361 

20 

33.467 

41.648 

46.701 





CORRADO GINI 267 

Table Ib: Various values of mMf in all the possible samples for m = 5, « — 3, 
and their arithmetic mean 


\ 

Elements of 
the sample 

P 

-2 

-1 

0 

1 

2 

3 

4 

1,4,6 

* 1.650 

2 069 

2.714 

3.333 

3.742 

3.986 

4.141 

1,4,10 i 

1.672 

2.222 

3.420 

5 

6.245 

7.080 

7.647 

1, 4, 80 

1 680 

2.376 

6.840 

28.333 

46.249 

55.47 

60.79 

1,6,10 

1.690 

2.308 

3.684 

6.333 

6.481 

7.213 

7.714 

1, 5, 80 1 

1 1.698 

2.474 

7.368 

28.667 

45.282 

65.47 

60.79 

1, 10, 80 

1 1.723 

2.697 

9.283 

30.333 

46.561 

56.51 

60.79 

4, 6, 10 

! 6.164 

5.465 

5.848 

6.333 

6.856 

7.346 

7.760 

4, 6, 80 

1 5.406 

6.486 

11.696 

29.667 

46.336 

56.48 

60.79 

4, 10, 80 

1 6.426 

8.276 

14.736 

31.333 

46.605 

65.51 

60.79 

6, 10, 80 

1 7.734 

9.600 

16.874 

31.667 

46.637 

65.61 

60.79 


3.484 

4.396 

8.146 

20 

29.998 

36.857 

39.20 


Table Ic; Various values of ctW the possible samples for w = 5, a = 2, 

and their arithmetic mean 


Elements of 
the sample 




P 




— 2 

-1 

0 

1 

2 

3 , 

4 

1,4 

1.372 

1.600 

2 

2.5 

2.916 

3.191 

3.367 

1,6 

1.387 

1.667 

2.236 

3 

3.606 

3.979 

4.106 

1, 10 

1.407 

1,818 

3.162 

6.5 

7.106 

7.940 

8.409 

1, 80 

1.414 

1.975 

8.944 

40.5 

56.57 

63.60 

67.27 

4, 6 

4.417 

4.444 

4.472 

4.5 

4.528 

4.555 

4.681 

4, 10 

.5.252 

.5.714 

6.225 

7 

7.616 

8.103 

8.462 

4, 80 

5.6.50 

7.019 

17.889 

42 

56.639 

63.50 

67.27 

3, 10 

6.325 

6.667 

7.071 

7.5 

7.906 

8.255 

8.637 

5, 80 

! 7.0.57 

9.412 

20 

42.5 

56.679 

63.50 

67.27 

10, 80 

1 

14.03 

17.778 

28.284 

45 

57.009 

63.54 

67.28 

P 1 

4.831 

5.869 

10.028 

20 

26.006 

29.006 

30.666 


Table II 

Comparison between the vahies of respective values of 

E{ )for m = 6, 6 = 2^ for different values of sand p 


P 

-2 

-1 

0 

1 

2 

3 

4 


3.132 

3.88 

6.931 

13.149 

17.386 

19.838 

21.436 

for: 

5 = 4 

5 = 3 

5 = 2 

3.698 

4.396 

10.028 

4.430 

6.488 

10.028 

7.361 

8.146 

10.028 

12.460 

11.647 

10.028 

16.784 

13.268 

10.028 

17.166 

14.199 

10.028 

18.183 

14.749 

10.028 
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Table Ila: Varioue values of ^M^in all the possible samples for m — 6, s — 4, 
and 6 s= 2, and for different values of p, and their arithmetic mean E{\M^) 


Elements of 
the sample 

P 

-2 

-1 

0 

1 

2 

3 

4 

1,4, 6,10 

2.323 

3.060 

3.761 

4.637 

6 274 

6.664 

6.914 

1,4, 6,80 

2.747 

3.403 

6.326 

11.764 

14.653 

16.909 

16.690 

1,4, 10,80 

3.008 

3.913 

7.621 

14.467 

18.806 

21.204 

22.681 

1, 6, 10, 80 

3.300 

4.224 

7.963 

14.972 

19.163 

21.402 

22.781 

4, 6, 10, 80 

6.611 

7.669 

11.247 

16.482 

19.718 

21.698 

22.849 


3.598 

4.430 

7.361 

12.460 

15.503 

17.165 

18.163 


Table Ilb: Various values of in all the possible samples for m = 6, s = 3 

and 6 — 2, and- for different values of p, and their arithmetic mean 


Elements of 
the sample 

P 

-2 

-1 

0 

1 

2 

3 

4 

1»4,6 

2.301 

2.449 

2.714 

3.109 

3.482 

3.638 

3.901 

1, 4,10 

2.621 

2.828 

3.420 

4.234 

4.890 

, 6.281 

6.616 

1,4, 80 

2.620 

3.361 

6.840 

11.60 

13.8 

14.933 

16.601 

1, 5,10 

2.778 

3.062 

3.684 

4.761 

6.439 

5.897 

6.166 

1, 6, 80 

2.940 

3.736 

7.368 

12.71 

16.035 

16.676 

17.44 

1,10, 80 

4.146 

6.136 

9.283 

17.22 

21.546 

23.666 

24.65 

4, 6,10 

6.400 

6.619 

5.848 

6.066 

6.223 

6.361 

6.448 

4. 6, 80 

6.417 

7.344 

11.696 

16.70 

17.204 

17.841 

18.20 

4,10, 80 

6.677 

10.11 

14.736 

19.66 

22.316 

23.797 

24.73 

6, 10, 80 

9.261 

11.24 

16.874 

20.41 

22.742 

24.019 

24.84 

mi^) 

4.396 

6.488 

8.146 

11.647 

13.268 

i4.199 

14.749 


Table III 


Comparison between the values of and the respective values of 
E{^M ^) for m 5, b = 3, for different values of s and p 


P 

-2 

-1 

0 

1 . 

2 

3 

4 


3.844 

4.465 

6.931 

9.994 

119.92 

12.933 

13.604 

s = 4 
s « 3 

4.470 

8.146 

6.368 

8.146 

7.361 

8.146 

9.394 

8.146 

10.619 

8.146 

11.134 

8.146 

11.498 

8.146 
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Table Ilia: Various values of in all the possible samples for m == 6, « =r 4, 
and 6 = 3, and their arithmetic mean E{\M^^) 


Elements of 
the sample 




P 




-2 

-1 

0 

1 

2 

3 

4 

1,4, 5, 10 

2.67 

3.42 

3.761 

4.264 

4.725 

5.027 

5.212 

1,4, 6, 80 

3.416 

4.143 

6.325 

8.363 

9.436 • 

10.052 

10.425 

1, 4, 10, 80 

4.296 

5.127 

7.521 

10.291 

11.834 

12.656 

3.133 

1,5, 10. 80 

4.627 

5.503 

7.953 

10.949 

12.702 

13.622 

14.144 

4, 6, 10. 80 

7.341 

8.647 

11.247 

13.104 

13.899 

14.313 

14.574 


4.470 

5.368 

7.361 

9.394 

10.519 

11.134 

11.498 


Table IV 

Different values acquired by with the variations in 

the values of b and p 


I 


6 

j P 

i -2 

-1 

0 

1 

2 

3 

4 

1 

2.12 

3.2 

6.931 

20 

36.172 

46.820 

53.503 

2 

3.132 

3.886 

6.931 

13.149 

17.385 

19.838 

21.436 

3 1 

3.844 

4.455 

6.931 

9.994 

11.992 

12.933 

13.504 

4 i 

4.586 

5.318 

6.931 

8.409 

9.321 

9.855 

10.205 

5 j 

6.931 

6.931 

6.931 

6.931 

6.931 

6.931 

6.931 


i 


Table V 


Different values acquired by with the variations 

in the values of b and p for^s = 4 


b 

P 

-2 

-1 

0 

1 

2 

3 

4 

1 

2.729 

3.682 


20 

33.457 

41.648 

46.701 

2 

3.598 

4.430 

7.361 

12.460 

15.784 

17.155 

18.183 

3 

4.470 

5.368 

7.361 

9.394 

10.519 

11.134 

11.498 

4 

7.361 

7.361 

7.361 

7.361 

7.361 

7.361 

7.361 
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Table VI 


■ Different values acquired by E{^M'P) with the variations 
in the values of h and p for s = 3 


b 

P 

-2 

-1 

0 

1 

2 

3 

4 

1 

3.484 

4.396 

8.146 

20 

29.998 

35.857 

39.200 

2 

4.396 

5.488- 

8.146. 

11.647 

1,3.268 

14.199 

14.749 

3 

8.146 

8.146 

8.146 

8.146 

8.146 

8.146 

8.146 


Resume 

Dans cette note, on montre les relations (iiii interviennent entre les 
moyennes d’une masse (population ou univers) et I’esperance mathe- 
matique des moyennes correspondantes d’un echantillon. 

A cet effet, nous rappelons les formules de la 
1 . Moyenne de puissances 


( 1 ) 



formule dans laquelle m indique le nombredes termes, % (i ^ 1,2, 
le terme general i®*"® et p fournit le degre de la moyenne; 


m) 


2 . Moyenne cowbinaforielle 


(2) 



formule dans laquelle indique le nombrede combinaisons d'es termes 

m, h k b, Oi le produit des b 414ments compris dans la oombinaisQn 
et 6 fournit le degri de la moyenne; 
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3 . Moyenne comhinatorielle df puissances 



formule dans laquelle bp fournit le degre de la moyenne. 

(1) et (2) constituent des cas particuliers de (3) pour = 1 et respec- 
tivement pour p = 1. 

Si nous designons par 

les moyennes pour la masse comprenant m elements et par 

E{,M) FAiM,) 

les esperances raathernatiques des moyennes respectives pour un echan- 
tillon comprenant s elements, on pent demontrer que 

A’UM?) I eCm^,) 

selon que le degre (respectivcment p, 6, bp) de la moyenne est ^ 1. 

On pent deduire de ce qui precMe, en particulier, que Tesperance 
matliematique de la moyenne geometrique et harmonique de Techantillon 
est superieure a la moyenne geometrique et harmonique respective de 
la masse, tandis que I’esperance mathematique de la moyenne quadra- 
tique, cubique, et biquadratique de Techantillon est inferieure k la 
moyenne quadratique, cubique et biquadratique respective de la masse. 

On peut demontrer aussi que: 

1 ) la difference entre la moyenne de la masse et Tesperance raathe- 
matique de la moyenne respective de Techantillon est d’autant plus 
grande que I’echantillon est petit; 

2 ) avec la variation de I’exposant p Tesperance mathematique de 
la moyenne de puissances ou de la moyenne combinatorielle de puiss¬ 
ances de Techantillon vg^rie moins que Tesperance mathematique de 
la moyenne respective de la masse, et plus petit I’echantillon, moins 
elle varie; 

3) si le nombre de termes (m) est egal, la valeur de la moyenne com¬ 
binatorielle de puissances varie avec la variation de p d'autant 

plus que b est petit. 



ON RANDOM Variations in 

STATISTICAL DATA* 

by Wilhelm Winkler 
University of Vienna (Austria) 

Note: This study is based on the Lexis method of measuring the dis¬ 
persion of relatives and other statistical measurements. That method, 
which appeared to belong to the established stock of statistical methods 
and was represented in every textbook on the theory of statistics or the 
theory of chance, has been attacked by some authors in more recent 
times as being unreliable and obsolete.^ 

Nevertheless, I believe that the Lexis method, though it may havp 
its faults, is indispensable in its ease of understanding and handling, 
and can never be replaced by more refined methods which are too 
exacting to be of broad practical use. 

The lack of literature prolonged for the third year after Austria’s 
“liberation” may also be the explanation and excuse, if it is found that 
the methods proposed in this study have been found by others before 
me. They are simple and obvious enough and may well have occurred 
to other investigators. Under those conditions this study is only meant 
as an unpretending contribution to the problem of sampling and as a 
basis for discussion, and I am still more willing than ever to accept cor¬ 
rection and instruction if needed. 

The Problem 

In spite of many excellent and ingenious investigations, sometimes 
requiring difficult mathematical work, there is still disagreement about 
the fundamental problem whether or not it is correct to apply the for¬ 
mulae of the theory of chance to statistical data; or, otherwise expressed, 
whether and to what extent experience reflected in statistical data fol¬ 
lows the pattern given in the theory of chance. 

The followers of the liberal line of thought answer in the affirmative: 
They can be recognized by their practice of setting ± E, that is the pro¬ 
bable error of the theory of chance, next to all proportions they can 
study, while they argue that actual life with its working of a multipli¬ 
city of individual causes, besides the general ones, may rightly be as¬ 
sumed to be a complete parallel to the games of chance. The followers 

*This paper is an abridged version of that presented at the conferences. A 
full version in German has been published in Statistische Vierteljahresschrift, I, 
Vienna, 1948. 

> See Oscar Anderson, Sit^uhrung in die mathematische StatisHk, Vienna, 1935, 
p. 300 ff., and literature quoted there. 
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of the strict line of thought assert there is no justification for the as¬ 
sumption of that parallel except in those few cases of time series com¬ 
posed of proportions based on a large number of observations each year 
for which “normal dispersion” (according to Lexis) has been proved. 

I believe that neither line of thought is quite correct and that there 
is a golden mean which better approaches the truth. 

When examining the first line of thought, we must not forget the 
rigorous conditions the classical (and also the new) theories of chance set 
up for the validity of those formulae: The best possible mixture during 
the whole course of sample drawings, say from a bag filled with balls 
of different colors in given proportions; unvarying composition in the 
bag from sample to sample; no limitations upon the free working of 
chance; complete independence between successive drawings. 

Changes in the basic probability from sample to sample increase the 
dispersion. They may be effected either by changing the composition 
of the colors of balls in our bag or by not fully mixing the contents so 
that draws may be alternately taken from different spheres of mixture 
in the bag. In samples taken from actual life changes have proved to 
be the rule, and stability the rare exception. In investigating time 
series of proportions we shall be unlikely to find normal dispersion, a fact 
which has already been stated by Lexis. But also the condition of per- 
feet mixture seems rarely fulfilled in actual populations: Rural and 
urban conditions are greatly different; there are rich and poor quarters 
in towns; there are agglomerations of one sex in barracks, colle’jibs, clois¬ 
ters, etc., agglomerations of people exposed to a higher morjbality in hos¬ 
pitals, of people with a greater tendency to emigration in sea-side places, 
etc. Thus it may happen that in taking successive samples out of the 
bag of social life we may, even witli the general conditions iJemaining un¬ 
changed, get samples from different corners of our bag which is not well- 
mixed. Thus, we may have the impression of a change in the gei\eral 
conditions without its being actual. 

Against these most frequent disturbing causes the last two, limitation 
of the free working of chance and dependence betw^een successive draw¬ 
ings, seem to be of lesser importance w ith actual observations. 

It follows from these considerations that the liberal line of thought 
seems to go too far and to need certain restrictions on its practice of un¬ 
critically applying probability formulae to actual series of proportions. 
On the other hand, the strict line of thought, recognizing the use of the 
probability formulae only in those cases w'here normal dispersion has 
been found, seems to me wrong too. The mistake seems to consist in 
denying the character of a probability to all those proportions which 
are not constant in time, as if that constancy in time w^ere a constitutive 
quality of a probability. Nobody will deny that the probabilities of 

35 
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survival and of mortality given in a mortality table are specimens of pro¬ 
bability, and no one will ignore the fact that those probabilities have un¬ 
dergone the greatest changes for the last seventy years in most countries. 
That mistake is an old one, and still older are its causes. 

Therefore, we must not find an argument against the applicability of 
the well-known “limits of significance” cr or E or their multiples, in those 
changes of the basic probability from sample to sample. It was just 
this that many of Lexis’ successors did, and do to this day. 

The present question is how to eliminate the disturbing effect of time 
and bring given statistical figures more nearly in accord with the condi¬ 
tions of random sampling. The best approach would be to take samples 
at random of every statistical mass of data as long as the original order 
of data, e.g,, the order in which population lives together in lodgings, 
houses, villages, and towns, is preserved. To execute that idea we may 
arrange unsorted punch cards in divisions and subdivisions of shelves 
and determine by lot the numbers and sub-numbers from which cards 
are to be drawn at random in order to form samples from them. Pos¬ 
sible limitations of chance or correlations between the units may be taken 
regard of, in order to imitate actual life as nearly as possible. Then 
the dispersion of these samples may be ascertained and compared with 
that of the Bernoullian distribution, using Lexis’ coefficient of dispersion 
Q = in which cr means the (actual) standard deviation observed, 
0*0 the (theoretical) standard deviation of the Bernoullian distribution. 
In this way we could obtain an idea of the effect of distorting causes of 
dispersion remaining after the exclusion of those of time, upon the dis¬ 
persion of the proportions to be dealt with, i.e., distortions caused by 
poor mixture of our material, or correlations, etc. Those a’s would give 
us the right measures for the probable errors of sampling appropriate to 
our material. 

That way, though theoretically easy, seems to me hardly feasible, 
as every acting statistician will certify. 

Therefore, I suggest another way of studying random variations in 
actual statistical figures: We may avail ourselves of figures given year 
by year, but not refer their variatiohs to the average for the appropriate 
period of time, as Lexis did, but to the trend of their change in time, cal¬ 
culated by some method of graduation. This may be done either by the 
method of moving averages (by which terms at the beginning and end¬ 
ing of our series are lost), or by the method of least squares in connec¬ 
tion with an assumption fitting the nature of that trend. Because of 
the progress of statistical studies on business cycles there is hardly a 
need for further justification of that device. 

The first example refers to some of the figures used by Lexis himself 
in illustrating his method. Using these figures saves us one part of the 
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calculation, as Q is already calculated in the Lexis way. Data are for 
the sex distribution of deaths for the ages 50 to 55 years in Belgium from 
1841 to 1860. (See Table I.) 

In the first column of Table I we find data on the sex distribution of 
deaths, not in the form in which Lexis used them—males to 1000 females 
—but transformed to probabilities. In the second column these figures 
are graduated in two segments from 1841 to the distinct culminating' 
point in 1847 by an algebraic curve of the third degree, centering in the 
year 1844, y= .471143 -h .004846.^: + .005096.c2 + .001550^;^; from there on 
by a straight line, centering in 1854, y = *542877 + *002904a:. The gra¬ 
duation in two segments gave a better fit and was admissible, as here 
there was not the question of finding one expression for the whole period 
of time but of finding the best fit, if necessary in two or more segments. 
In column 3 we have the deviations of the observed from the graduated 
values, in column 5 from the general average of the observed values, 

Table I 


Proportion of MaloH among all l^eaths of Ages 50 to 65 in Belgium 1 


Year 

Proportion of males 
rough graduated 

y y' 

X X 10< 
{\=y-y') 

X= X 10» 

S X 10* 

(5=^ — 0.6292) 

6® X 10» 


1 2 

3 

4 

5 

6 

1841 

0.4566 0.4576 

20 

400 

-736 

541,696 

1842 

0.4731 0.4674 

+ 57 

3249 

-561 

341,721 

1843 

0,4650 0.4688 

- 38 

1,444 

-642 

412,164 

1844 

0.4703 0.4711 

- 8 

64 

-580 

346,921 

1845 

0.4829 0.4836 

- 7 

49 

-463 

214,369 

1846 

0.5188 0.5166 

f 32 

1,024 

-104 

10,816 

1847 

0.5750 0.5764 

- 14 

196 

4 468 

209,764 

1848 

0.6185 0.5256 

- 70 

4,900 

-107 

11,449 

1849 

0.5323 0.6284 

+ 

1,521 

-f 31 

961 

1860 

0.5261 0.6313 

- 52 

2,704 

- 31 

961 

1861 

0.5396 0 5342 

4- 54 

2,916 

4-104 

10,816 

1862 

0.5381 0.6371 

f 10 

100 

4- 80 

7,921 

1853 

0.5467 0.5400 

1- 67 

4,489 

4-176 

30,625 

1864 

0.5392 0.5429 i 

- 37 

1,369 

1-100 

10,000 

1855 

0.6546 0.6458 

4- 88 

7,744 

4-254 

64,516 

1856 

0.5660 0.5487 

-h 73 

5,329 

4-268 

71,824 

1857 

0.5292 0.6516 

-224 

50,176 

4- 0 

0 

1858 

0.5632 0.6546 

- 13 

169 

4-240 

67,600 

1859 

0.5633 0.5574 

4- 69 

3.481 

f341 

116,281 

1860 

0.6606 0.5603 

4- 3 

9 

4-314 

98,596 

Total 



91,233 


2,632,001 

Weighted 

average 

0.5292 






t Figures for column 1, the weighted average and the coefficient of dispersion either given by, or 
computed according to, W. Abhandlungen fheorU dw B^olkerunga-und MorahtaiUHkt Jena, 

1903, p. 198 ff, 
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given by Lexis, was calculated from the values for the coefficient of 
dispersion Q given by Lexis. 

Thus we have the rough coefficient of dispersion 

Q==4.3 (Lexis), 
and the corrected coefficient of dispersion 

= 0.82 

according to the above method. 


n—1 


365.06X10- 

^ n- 1 

10-^^ 

= 69.333 X 10 * 


According to Lexis’ computation Q = 4.3, 
therefore 




Q 


365.06 
4.3 


X = 84.898 X 10"^ 


Q' 


cTg ^ 69.333 
Vo ““ 84.898 


= 0.82 


The probable error according to the Bortkiewicz Formula Eq = 
.6745/^2^1 would be 0.11 so that Q' lies near the lower J^q limits, l±.ll, 
and well within its fourfold reach. As there is no visible reason for 
subnormal dispersion, we may assume the deviation of Q' from unity 
is caused by chance and infer that the strong supernormal dispersion of 
the first way of computing Q has been changed to normal dispersion by 
eliminating the temporal trend in the change of the sex ratio of deaths 
of that age and time. 

A second similar example was computed from the proportion of re¬ 
cruits of height 166 to 170 cm among all 21-year-old recruits in the Vien¬ 
na military territory from 1892 to 1912. (See figures in the author’s 
Orundriss der Statistik I, 2nd ed., Vienna, 1947, p. 52.) The rough co¬ 
efficient of dispersion according to Lexis was Q = 3.251, the corrected one 
Q' = 2.681, lower than the rough one as expected, but by far not lower 
so much as in the first example. We conclude that the recruits of the 
several years were far less homogeneous in their height distribution, so 
that we failed to obtain normal dispersion as in example 1, after elimina¬ 
ting changes in time caused by the slow but steady increase of height. 
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A. Observed figures 


1926 1 

19 

26 

19 1 

12 

8 I 

^ 1 

1 93 

1927 ! 

21 

20 

17 

14 

14 1 

7 1 

1 93 

1929 

21 

29 

24 

17 

9 

12 

1 112 

1930 

28 

36 

22 

14 i 

10 

5 1 

! 115 

1931 

35 

36 

! 35 j 

10 

12 

7 

1 135 

1932 

29 

54 

35 1 

24 

9 

8 

j 159 

1933 

30 

42 

40 

! 16 

7 

8 

j 143 

1935 

23 

31 

40 

26 

11 

2 

133 

1936 1 

34 

51 


29 

14 

11 

180 

1937 1 

36 

1 33 1 

41 

18 

17 1 

4 

149 

Total i 

276 

i 358 

314 

180 

i 111 

! 73 

1312 


1 Figures from Statistiscfies Jahrbuch fur die Schweiz for the respective years. 


B. Relative distribution 


1926 

20.43 j 

27.96 

20.43 

. 12.90 

8.60 

9.68 

i 100.00 

1927 

22.59 1 

21.51 

18.28 

15.05 

15.05 

7.52 

I 100.00 

1929 

18.75 1 

25.89 

21 43 

15.18 

8.04 

10.71 

' 100.00 

1930 

24.35 1 

31.30 

19.13 

12.17 

8.70 

4.35 

100.00 

1931 

25.93 1 

26.67 

' 25.93 

7.41 

8.88 

5.18 

100.00 

1932 

18.24 : 

33.96 

22.02 

15.09 

5.66 

5.03 

100.00 

1933 

20.98 

29.37 

27.97 

11.19 ! 

4.90 

5.59 

i 100.00 

1935 

17.29 

23.31 

30.08 

19.55 

8.27 

1.50 

i 100.00 

1936 

18.89 

28.33 

22.78 

16.11 i 

7.78 

6.11 

' 100.00 

1937 

24.16 ; 

22.15 

27.52 

12.08 

11.41 

2.68 

, 100.00 

Average 

21.04 ! 

27.29 

23.93 

13.72 i 

8.46 

5.56 

1 100.00 




C. Some 

other values 




Q 

0.831 i 

1.033 

1.094 

1.093 j 

1 

1.177 

1.428 
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Table TI, Continued 



Arithmetic 



• 

Year 

mean^ 

X- 32.80) 

Qa 

* 1X —\o| 


1 

2 

3 

4 

1928 

34.03 

fl.23 

1 1.33 

().i)0 

1927 

36.11 

1-2.31 

+ 0.62 

1 1.69 

1929 

36.00 

f 2.20 

+ 0.59 

1.61 

1930 

31.26 

-1.54 

-0.41 

1.13 

1931 

31.22 

-1.58 

-0.43 

1.16 

1932 

32.11 

-0.69 

-0.19 

0.50 

1933 

31.64 

-1.16 

-0.31 

0.85 

1935 

33.27 

i fO.47 

i h0.13 

0.37 

1936 

33.39 

+ 0.59 

+0.1H 

0.43 

1937 

32.26 

-0.56 

-0.15 

0.40 


Xx = 32.80; 
<Tx = 14.29; 

Q, = 


== 


= = 1.463; 

Vn-1 

= 0.394; 


Va"-i 


‘•«3 ^ 3,13 

0.394 


* In computing the ariilimetic mean the first and the last groups have been conceived as stretching 
over 10 years of age. 


A third example in Table II concerns a full age distribution, the first 
entrance of mentally defective women into institutions in Switzerland. 
The total of 1312 cases is not very great but great enough to allow it to 
be roughly assumed as a universe from which the samples of the several 
years are taken. 

Here, too, we may apply the above method in the various columns 
representing the various ages as well as in the column of the arithmetic 
means. Thus, e.g., the coefficient of dispersion for age 60 is lessened 
from Q = 1.428 to Q* — 1.145; the coefficient of dispersion of the arith¬ 
metic means = 3.713 to Q\ = 1.669, in the first case using a straight 
line with the origin in 1932, y* = 5.6086 — 0.5661a;, in the second case an 
algebraic curve of the fourth degree^' = 31.314 + 0.058763a;+0.337451 
--“0.015197a:3 — 0.009579a;4, in graduating the curve of values according 
to the method of least squares. Using the Bortkiewicz formula for 
the significance of normality of dispersion aQ = l/\/2n in the form of 
the probable error JS7q = .6745 we have the limits 1 zt .15, so that the 
value obtained for Q' for age 60 hints of normality in a much more 
definite way than in its original form, whereas though considerably 
diminished, remains supernormal, outside the limits of 4 :Eq. 
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From those two results we would be inclined to infer that the age 
distribution observed has less stability as a whole than in its details. 

I think that inference would be erroneous, as the seeming stability in the 
age groups is a mere formal consequence of the smallness of the samples, 
in which case, as we know, the “combinatoric” component (Lexis) of the 
coefficient of dispersion outweighs the “physical” one, thus giving a 
misleading picture of normal dispersion. 

That assumption seems to bo justified by the run of the coefficients 
of dispersion in all age groups. Here we have the surprising picture 
of a rising series of coefficients of dispersion, with only one exception, 
so regular that we may rightly assume those differences to be real. In 
the youngest group the dispersion is subnormal, in the oldest groups, 
supernormal; in the middle groups there is uncertainty because of the 
spurious normality mentioned. Supernormality should not be sur¬ 
prising in view of the fluctuations observed in the arithmetic means; 
subnormality, as there is no reason to assume negative correlations of 
the units, could only be explained by regulations influencing the frequen¬ 
cy of entrance into lunatic asylums in the youngest group, either in the 
nature of the illness, or in the policy of admittance in the Swiss lunatic 
asylums, or in something else which the medical experts may find out. 
Only one question may be answered by the statistician, whether or not 
formal causes may have been at work. Such a cause may be the shifts 
which this and all other age groups are bound to have undergone by the 
shifts in the whole age distribution indicated in the oscillations of the 
arithmetic means. That question may be answered in the following way: 

It is necessary to shift back the cases causing changes in the age groups 
as a consequence of that general shift, to an order that would be expected 
if only random oscillations had influenced. that distribution. We may 
assume that shift parallel throughout the groups, which assumption, 
though a rough one, is suggested by its simplicity as well as by the diffi¬ 
culty of a clear separation of the significant and the random oscilla¬ 
tions in those details. 

The way to execute that idea is this: First we compute the coefficient 
of dispersion of the arithmetic means by the Lexis method, which has 
already been done above; then we correct the given deviations of the 
several arithmetic means from that of the sum by dividing them by 
that coefficient of dispersion by which division the deviations are trans¬ 
formed to values A„ corresponding to Qa == 1 • According to those changes 
in the deviations we establish the corresponding shifts in the arithmetic 
means and in the whole age distribution, the latter in the way that each 
group cedes the number of persons to the neighboring group corres¬ 
ponding to the stretch of shift in an equal distribution. The results of 
that computation are given in Table III. 
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The coefficients of dispersion Q" have not considerably changed in 
the middle columns; the coefficient of thehighestage group has diminished 
towards unity in a way similar to the result of the method of corrected 
deviations. The coefficient of dispersion in the lowest group, however, 
has proved to be still subnormal after that adaptation of the distribu¬ 
tions. That leads us to assume that that subnormality really existed. 

Summary and Conclusions 

Applying a modification of Lexis’ method in taking the deviations 
of the observed values not from the average of our observations but from 
their graduated curve, we have attempted to exclude changes in the 
basic probability of our universe arising in the course of time. Thus 
we obtain the dispersion which we may assume in an actual case 
without taking into account changes in the past and possible similar 
changes in the future. In this way we have made the given observations 
conform more nearly to the model of samples taken at random under 
the exacting conditions of the theory of chance. Where then a disper¬ 
sion resulted greater or smaller than the normal one, we should assume 
the working of the remaining causes of disturbance: in the case of super¬ 
normal dispersion bad mixture in our “bag” from which the samples 
were taken, or positive correlation between the units of our sample; 
in the case of subnormal dispersion the working of limiting regulations 
or negative correlation between the units. Only where normal disper¬ 
sion was also found, was the application of the limits of the theory 
of chance verbally right. In the cases of subnormal dispersion it was a 
superfluous precaution. In the case of supernormal dispersion it was a 
hazardous trusting in insufficient limits. 

Testing all available data according to the method of excluding temporal 
changes we could determine for what kinds of data those limits are 
reliable, and for which we have to mistrust them. 

In our three examples we have found in one case, the sex distri¬ 
bution of deaths of a higher age, a change from the alleged supernormal 
into normal dispersion; in two other cases, the proportions of recruits 
of age 21, 166 to 170 cm. high, and the average age of mentally defective 
women entering institutions, the dispersion which remained super- 
normal. In the two latter cases we believed the supernormal dispersion 
was caused by insufficient mixture in the universe, which seems to be 
the general fault with actual samples, apart from those changes in 
time excluded by our method. 

It seems already apparent from this short study that the sphere of 
application of those limits is broader than the strict lines of thought 
admits, but narrower than the liberal line of thought assumes. There¬ 
fore, using the known limits of significance in all cases indiscriminately, 
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we rmy take them as a symbolic reminder that the given results are not as 
definite as they present themselves ^ rather than as a real, scientifically proved 
fact. 


Tablk III 


Acljustod figures of Table II 


1 

Age group 


0-19 I 20-29 1 

30-39 

40-49 1 60-69 

60 -f- j 

' 1 ; 2 i 

1 ! 1 

3 

4 1 5 

6 i 7 

j 


A. Adjusted observ’^ed figures 


1926 

21" 

26 

-18 

12 

8 

■'8 

93 

1927 

24 

20 

16 

14 

13 

6 

93 

1929 

26 

28 

23 

15 

10 

10 

112 

1930 

25 

35 

24 

14 

11 

6 

115 

1931 

31 

36 

35 

13 

12 

8 

135 

1932 

28 

62 

36 

25 

10 

8 

159 

1933 

27 

41 

41 

18 

7 

9 

143 

1936 

24 

31 

40 

25 

I 11 

2 

133 

1936 

36 

51 

40 

29 

13 

11 

180 

1937 

36 

33 

40 

19 

17 J 

6 

149 

Total 

277 

353 

313 

184 

112 

73 

1312 


B. Adjusted Relative Distribution 


1926 

22.68 

27.97 

I 19.35 

12.90 

8.60 

8.60 

100.00 

1927 

25.81 

21.51 

17.20 

15.05 

13.98 

6.45 

100.00 

1929 

23.21 

26.00 

20.54 

13.39 

8.93 

8.93 

100.00 

1930 

21.74 

30.43 

20.87 

12.17 

9.57 

5.22 

100.00 

1931 

22.96 

26.66 

25.93 

9.63 

8.89 

5.93 

100.00 

1932 

17.61 

32.70 

22.64 

15.73 

6.29 

5.03 

100.00 

1933 

18.88 

28.67 

28.67 

12..59 

4.90 

6.29 

100.00 

1936 . 

18.05 

23.31 

30.08 

18.80 

8.26 

1.50 

100.00 

1936 

20.00 

28.33 

22.22 

! 16.12 

7.22 

6.11 

100.00 

1937 

23.49 

22.15 

26.84 

12.75 

11.41 

3.36 

100.00 

Average 

21.11 

26.91 

23.86 

14.02 

8.64 

6.66 

100.00 


0.766 

0.948 

1.148 

0.845 

1.156 

1.099 



Resume 

Par utte modification de la raethode de Lexis, nous avons t&che d*6li- 
miner les changements dans le temps de la probability de base. Cette 
modification consiste k prendre les deviations des valeurs observ^es non 
de la moyenne des observations mais de leur courbe ajust^e. Nous 
36 
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obtenons ainsi la dispersion k un moment donn6 sans qu’elle soit in¬ 
fluence par des changements dans le passe et d*eventuels changements 
similaires dans Tavenir. Nous avons ainsi rapproche les observations 
au module d’echantillonnage au hasard sous les conditions imposees par 
le calcul des probabilites. La ou une dispersion est plus grande ou plus 
petite que la dispersion normale, nous pouvons I’attribuer k I’influence 
de causes perturbatrices: dans le cas de dispersion hypernormale, que 
le contenu de Turne d’oii les echantillons sont tires n’est pas homogene, 
ou qu’il y a correlation positive entre les tirages successifs; dans le cas 
de dispersion hyponormale, Taction de regies restrictives ou dec corre* 
Istion negative entre les tirages. Seulement 1^ oh on obtenait la disper¬ 
sion normale, Tapplication des limites de la theorie des probabilites 
etait litteralement exacte. Dans le cas de dispersion hyponormale 
c’etait une precaution superflue. Dans le cas de dispersion hypernormale 
c’etait une confiance hasardeuse dans des limites insuffisantes. 

En analysant les donnees suivant la methode d’elimination des change¬ 
ments dans le temps, Tauteur pouvait determiner les cas dans lesquels 
ces limites sont sures, et ceux dans lesquels il ne faut pas se fier. 

Dans les trois exemples donnes par Tauteur, il a trouve dans un cas, 
la distribution par sexe des docfes a un age elev^, le changement d’une 
dispersion consideree comme hypernormale, dans une dispersion normale; 
dans deux autres cas, la proportion des recrues de 21 ans mesurant 166 
4 170 cm., et T4ge moyen de femmes k d6ficience mentale admises dans 
des institutions, une dispersion qui reste hypernormale. Dans les deux 
derniers cas, nous croyons que la dispersion hypernormale est causee 
par le fait que la population n’est pas homog^ne, ce qui semble etre le 
defaut general d’echantillonnages, en dessus des changements dans le 
temps 61imines par la methode proposee ici. 

Cette courte ^tude montre dejh que la sphere d’application des limi¬ 
tes de signification telles qu’elles sont couramment employees est 
d’une part plus large que certains auteurs Tadmettent mais d’autre part 
plus etroite que ne Tadmettent d’autres auteurs. C’est pourquoi, 
en utilisant ces limites dans tous les cas sans discrimination, on peut 
les consid^rer comme un rappel que les resultats pr^sentent un certain 
degre d’incertitude, plutot que comme donnant une mesure exacte 
de cette incertitude. 
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’Discussion 

Mr. Bernstein compared Mr. W i n k 1 e r’s treatment of time 
series with that of L e x i s. Mr. Bernstein indicated that Lexis took 
the moving average into account and calculated a somewhat different 
dispersion. 

Mr. R a s c h pointed out that the Lexis coefficient should be inter¬ 
preted as having two aims. One of these, he said, is to test the hypo¬ 
thesis that the probability in question is a constant one, in which case 
no adjustment should be made according to time. The hypothesis is 
wrong if the Lexis coefficient does not fall within the limits given by 
the chi-square distribution. When the hypothesis is wrong, Mr. Rasch 
added, an alternative hypothesis may be formulated in such a way that 
the Lexis coefficient could measure which way the probabilities are 
varying. 



Statistical methodology section 


Wedneadau, September^ 10, at 9:30 a.m.* 


Uses of Probability Theory in Economic and Social Sciences. 

Chairman : 

Tjailing C. Koopmans 


POSSIBILITIES AND LIMITATIONS OF THE 
APPLICATION OF MATHEMATICS AND, 
PROBABILITY THEORY IN PARTI¬ 
CULAR, IN THE FIELD OF SOCIAL 
AND ECONOMIC PHENOMENA 

by Maurice Fr6chet 
Paris Faculty of Sciences {France) 

Summary 

At the request of the Bureau of the International Statistical Institute 
the author established an inquiry among scientists of different countries, 
asking their opinion about the possibilities and limitations of the appli¬ 
cation of mathematics, and probability theory in particular, in the field 
of social and economic phenomena. 

A report on this inquiry, iii French, including the full text in the ori¬ 
ginal language of the replies received from 17 scientists, has been pub¬ 
lished in the Revue of the International Statistical Institute.^ 

In this summary we will only formulate opinions and judgments 
based on the answers to our inquiry. 

Some people think that human sciences deal with too complex phenom¬ 
ena for mathematics to be able to describe them. In fact, the primary 

♦ Joint meeting with The Economic Society. 

‘ Maurice Fr^chet, **D6gager les possibilit^s et les limites de 1’application des 
aoiences math^matiques (et en particulier du calcul des probabilit6s ) & I’^tude 
des ph^nom^nes ^conomiques et sociaux (i?eeue Inst. Int. de Stat., 1946, p. 16-61). 
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elements of mathematics have always been utilized by economists as 
soon as economics existed. Furthermore, the higher parts of mathema¬ 
tics which have been employed later by a few economists have exerted 
an indirect influence on the other ones. For mathematics require 
more precise definitions, they put more emphasis on functional depen¬ 
dence than on causality, and so on. Thus the question really reduces to: 
are higher chapters of mathematics directly useful to human sciences? 

We have considered three main ways to apply mathematics in human 
sciences. In the first, schemes of very general scope are built on a few 
postulates in such a manner that they may be expressed mathematically, 
and that they reduce the economic problem to a mathematical problem. 
It is this first method which has evoked the most violent criticism be¬ 
cause it is generally impossible to verify numerically either its premises 
or its conclusions. However, this method gives results which may be 
verified qualitatively, and it helps understanding the ecornomic connec¬ 
tions: Similarly when in theoretical mechanics a proposition is ‘‘friction 
being neglected,” then in many practical mechanical problems it cahnot 
give numerically good results but it gives a first preliminary idea of 
what may happen. It is this method which has been brilliantly utilized 
by Cournot, Walras, Jevons, Dupuit, Pareto, Marshall, Irving Fisher, 
and so on. It has brought to the foreground the now classical notions 
of marginal utility, of elasticity, of economic equilibrium, among many 
other ones. 

The second way to utilize mathematics in social sciences appeared 
later, because it makes great use of statistical data and these data were 
first inexistent or unreliable. It does not aim at such general descrip¬ 
tion of the economic or social world as the first method but limits it¬ 
self to the study of particular economic or social phenomena where 
numerical verification is possible. Such is, for instance, the question 
whether economic cycles exist, which are their periods if any, and how 
can they be explained rationally. Such also is the introduction of in¬ 
dex numbers, their use and their theory. 

The third way to apply mathematics consists in considering that, when 
there seem to exist functional relations between some economic or social 
magnitudes, these relations are really random ones or as is said now 
they are stochastic relations. Instead of trying to find mathematical 
exact relations between these magnitudes, the question is to find the 
probability law which governs the set of these magnitudes. This appears 
the best way for escaping the difficulty presented by the discrepancy 
between observed magnitudes and magnitudes conputed on the basis 
of theory. 

Studying the limits to be imposed on the application of mathematics 
to social sciences, there is a general consensus that even the most recent 
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or difficult chapters of mathematics may be legitimately employed in 
social sciences provided it be understood that their use would not entitle 
their economic conclusions to be safer. 

A real limit is in the limited power of mathematics themselves. When 
an economic problem has been reduced to a mathematical one, there 
is not always a mathematical method of solving this last problem. 

Some mathematical economists think that mathematical economics 
is but one of the ways by which economic problems must be approached. 
Finally, a very important limitation arises from the fact that as soon 
as an economic law were proved, people hearing of it and trying to avoid 
its disadvantageous consequences would make it false. 
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Discussion 

Mr. J. R. N. S t o n e gave two examples of the use of mathematical 
methods in economic investigations and of the problems to which they 
arc properly applied. The first example, related to the field of pure eco¬ 
nomic theory, was the work by von Neumann and M o r g ous¬ 
ter n on the theory of games. The importance of their work said Mr. 
Stone, is in their pointing out that where imperfect competition exists 
one does not have the type of mathematical problem which has normally 
formed the foundation of pure mathematical economics. There is a need 
for further development in mathematics to express realistically this 
situation in the economic world. 

Mr. Stone’s second example, in the field of econometric applications 
was concerned with the question of model-building. He pointed out 
that realistic economic models will contain stochastic elements, which in¬ 
troduce an element of unpredictability into the system. He added that 
it is impossible to foresee all the disturbances to which an economic 
system may be submitted; moreover, the structure of the system may 
change. Prediction consists partly in telling what will happen if the 
structure is changed in a particular way. As a matter of methodology, 
Mr. Stene believes, all possible factors should be built into economic 
models. 

Mr. Stone summarized his views on the scope of mathematics in 
economics, stating that the complexity of the situation would probably 
require exceedingly complicated methods for more than an approximate 
analysis. He added, on the other hand, that imperfect analyses (such 
as regression analysis) can be of value to politicians, civil servants, and 
business men of the present time. 

Mr. Rubin remarked to Mr. Stone that mathematical models can¬ 
not be improved unless there is information about the possible distur¬ 
bances (other than there being stochastic relationships) that can be 
accommodated in the model. 

Mr. Wold commented on applications of statistics in experimental 
fields, as different from these in non-experimental fields. He noted the 
common experience that different statistical methods are applied in 
different situations. 

Mr. Wold outlined the broad categories of statistical methods: Regard¬ 
ing the factors under analysis as variables in the mathematical or in the 
probabilistic sense, these variables are observed in the empirical sciences. 
In causal analysis, one category is concerned with theory working just in 
terms of the observed variables; in another category it may be found 
convenient to introduce also other, unobserved variables. In the first 



288 INTERNATIONAL STATISTICAL CONFERENCES: t S 1 

category, two cases may be distinguished, where experiments are possible 
and where they are not. In the second category, where causal factors 
are unobserved, experiments are in general impossible. 

Where experiment is possible, Mr. Wold concluded, the results are reli¬ 
able; in other fields, however, the analysis is liable to errors of method— 
problems become more difficult and the results more vague and unreliable, 

Mr. Bernstein remarked on the development of mathematics for 
application to such phenomena as sunspots, and on the developments 
of mathematics superseding correlation analysis for the analysis of time- 
series. 

Mr. Bernstein also illustrated the problem of mathematical models 
with his experience in the analysis of cotton prices. 

Mr. R u e f f stated, with reference to the comments by Messrs. Wold 
and Bernstein, that the random character of a variable depends essentially 
on the technical means at the disposal of the observer (or of the govern¬ 
ment), and on the skill and character of the observer. Moreover, this 
rondom character of a variable varies with time. He observed that 
in this respect the social sciences are only in degree in a different position 
from the physical sciences. 

Mr. L u t f a 11 a noted the limitation which exists on the application 
of mathematics in other fields of social science than economics. If 
economic theory may be defined as a logic of judgment of economic 
values, he asked, does there exist also a logic of other social values? 

Mr. F r e c h e t illustrated Mr. Stone’s comments with the following 
examples of the development of mathematics: (1) In theoretical mecha¬ 
nics, “integral differential equations” have been introduced, which 
permit the study of irreversible phenomena; (2) Mr. Allais has treated 
mathematically the Pareto definition of maximum satisfaction, 
dealing with the comparison of two economic states, where one may 
or may not be able to determine which is preferable. 

Mr. Fr6chet added that in the mathematical treatment of random 
phenomena, a distinction should be made between those resulting from 
the accumulation of many small causes and those which are the effect 
of one phenomenon of considerable intensity. 

•' Mr. N a n d a and Mr. 8 h a s t r i also participated in the discussion. 
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Suppose we want to predict the extent of shortage (or surplus) which 
will occur if the government fixes the price of a commodity at a certain 
level. At this price level, supply of the commodity may be equal to de¬ 
mand, but it may also exceed or fall short of demand. When I say that 
we want to predict the extent of shortage, or of surplus, of the commodity 
i.e., the difference between demand and supply, resulting from fixing 
the price at a given level, I use the term prediction in a sense different 
from that in which Mr. Stone used the term a few minutes ago. When 
discussing M. Frechet’s report on the results of the questionnaire on the 
scope of probability theory in social science, Mr. Stone said that, because 
of the stochastic character of economics, economic prediction is not possi¬ 
ble. That is true under a narrow definition of prediction, a definition which 
if applied rigorously, would exclude prediction from almost all empirical 
sciences, inasmuch as almost all empirical laws arc, strictly speaking, 
stochastic relations similar to the economic relations that I shall 
treat in my example. 

Let us define prediction as the estimation of the probability distri¬ 
bution of a certain random variable or of the joint probability distribu¬ 
tion of a set of random variables (the “predictand"' set), given the values 
of certain other variables (the “predictor*’ set).^ In that sense, the shortage 
which we shall denote by y\ can be predicted if we can estimate its 
conditional distribution, given p*, the price fixed by the government. 
The best known, though not the only possible technique of estimating 
any distribution is the “parametric” estimation: one or more parameters 
of the distribution are estimated on the basis of statistical data, after 
having used some previous knowledge independent of those data, to 
specify in advance other parameters, and the form itself, of the dis¬ 
tribution function. Similarly we can speak of the parametric estimation 
of a stochastic relation such as the relation 

(1) /(y. = 

where » is a non-observable random “disturbance” with zero-mean. 

* This article will be included in Cowles Commission Papers, new series, no. 32. 
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The form of the distribution function of v, as well as the form of the func¬ 
tion / relating vto the observable variables have to be specified 

a priori before proceeding to the estimation of the parameters of these 
functions on the basis of observations. A particular case of (1) is the 
prediction equation of y for a given p"^^ such as 

(2) y -= R(p^) + 

where v is a “prediction error”, distributed normally with zero mean 
and with unknown variajlce while jR( ), a “regression function,” 
is specified with respect to its form (e.g., linear) but not with respect 
to all its parameters. It follows that, for every fixed value of p***, the 
predictand y will have a normal distribution characterized by the expec¬ 
tation (mean) of y given p*, 

(3) {yW*) R(p*), 

and by the variance of y given p*, i.e.y the square of “the standard error 
of the estimate,” 

(4) c72 (pIp*) = a,,. 

Hence the estimation of the unknown parameters of the regression 
function i?( ),. and of the unknown parameter of the distribution 

of V, will suffice to estimate the stochastic “prediction relation” (2), and 
also to predict the variable y. 

I shall now try to show that useful prediction requires different pro¬ 
cedures according to whether experiments are or are not possible. 
Economics will be shown to require techniques not developed in experi¬ 
mental sciences. Specifically: the economist may have to predict the 
results of introducing price control, not on the basis of experiments 
with price control but on the basis of observations which were made in 
the absence of price control. 

Denote by the demand, and by the supply, at time t. Hence, 
shortage — Let p^ be the price which is either the free market 

price or the government fixed price as the case may be. Suppose that 
for any t, the behavior of buyers and that of sellers is described, respective¬ 
ly, by 

(6) t = ^t + demand equation; and 

(6) + L{Pt? supply equation. 

Here both demand and supply depend on price and, in addition, on a 
whole set of "'predetermined” variables such as weather, tax-rates, past 
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crops, etc. Some of these variables may appear in both equations, others 
in only one of the two equations. We denote the set of all predetermined 
given variables by a single symbol Zf Both the demand and the 
supply functions are linear, as indicated by the symbol L{ ); but they 
have different and, in general, unknown coefficient-sets, and respec¬ 
tively. For brevity, we shall also use a single symbol a = a«). 

Finally, the behavior of both sellers and buyers is stochastic: we suppose 
both to be subject to ‘‘random shifts,’’ or disturbances, u\- These 
are non-observable random variances and covariances forming a matrix 


cr 


I 

j 




Here need not be zero since buyers’ and sellers’ behavior shifts may 
b'3 correlated. The average “violence” of these disturbances is measured 
by respectively. 

The parameters a of the demand and supply functions are properties 
of behavior or technology; so arc the distribution parameters o*. All 
these parameters are necessary to describe the “structure” of the market. 
I’hey are, however, not sufficient. The stochastic system (5), (6) consists 
of only two equations in the three variables that are not 

determined by outside forces. Therefore, the values of these variables 
are not yet determined. The system becomes complete if supplemented 
by a third equation. Under price-control, this equation is 

(7') Pi-=Pi*, 

where pt* is some constant chosen by the government for the time t. In a 
free market we may have, instead, 

(7*) = xl 

if we assume that sellers adjust production instantaneously to wipe out 
the shortage or surplus, shown by decreasing or increasing stocks on 
hand—the simple static theory of economic textbooks which at best 
is a first approximation. (A somewhat more realistic, dynamic theory 
might introduce a positive lag A> in i^ — Pt = 

^ 

We can combine equations (7') and (7'’) into a single one. 


(7) {x^ — xl)8 + (pt — pt*)f 0, 


where (S, e) 


r= (1, 0) in free market; 

(0, 1) under price control, 
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The ‘‘structure'’ of the market is then described by the numerical 
values of the parameters (a, cr, 8, e). We see that structure depends on 
men’s behavior, technology, legal rules. 

Now let me proceed to our problem of predicting the extent of shortage, 
y^z=x\ — xIj as the result of fixing the price at pt = Pi*- Usually, obser¬ 
vations will have been collected under the condition that (8, e) = (1,0). 
But prediction is to be made for the situation (8, e) = (0, 1). There is 
a change of structure—a known change to be sure—^between the time 
of observed and the time of predicted events. 

This is characteristic of the non-experimental case. I shall call it 
Case B. When experiments are possible I shall speak of Case A. In 
our economic problem, an imaginable experiment would consist in deli¬ 
berately fixing the price at various values and observing the results. I 
shall briefly study this imaginable Case A before proceeding to the actual, 
non-experimental Case B. 

Let us, then, assume that we can fix prices, from experiment to ex- 
periment,at varying values That is (8,c) = (0,1) for t~ 1, 

T. Our object is to predict the shortage, say, i/t+i = 
when, at time T+l, the price is fixed at i?T+i** This prediction is 
obtained by at least two, logically distinct procedures. Both occur in 
exj)erimental sciences. I shall call the two procedures, the specific ex- 
periment and the general experimenty and denote them, respectively, by 
A1 and A2. Examples of specific experiment are the testing of model 
bridges, or the testing of airplanes in aerodynamic tunnels. Here the ex¬ 
periment consists in reproducing the specific structural change whose 
effect one wants to predict. The original structure is not the subject of 
investigation. General experiments, on the other hand, are designed, 
not to predict the results of a single specific structural change, but to 
make possible the prediction of the results of any possible structural 
change. Experiments made in physical laboratories to establish funda¬ 
mental laws of physics or chemistry are of this kind. The time required 
to boil an egg can be estimated by boiling eggs; but, in principle, it can 
also be estimated by studying first the general properties of protein 
molecules, in which case not only the answer of the egg-boiling question, 
but of many other questions as well, will be prepared. 

In our economic case, a specific experimenty (Al) would run as follows. 
The experiment—conducted, say, in a sm'all community—replaces the 
random variables in (5), (6) by constants pt*, for t running from I 
through T+1, Therefore, if we define 

(8) Vt = — u\ and 

(9) ^8 = a"* — a% we have 

(10) = »t + »i; j8), < = 1.T+l, 
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Since Vt is, by (8), normally distributed with zero-mean, equation (10) is 
a prediction equation, exactly like (2). As in (3), (4), the conditional 
mean and conditional variance of the predictand are functions of 
given values of the predictor set {p^*, z^Y 


( 11 ) 


^ (f? (/A 1 V*> 2t) = 


( 12 ) 


» C? I (S'. 


/V, 


1 - 


(j*« -2a^^% by (8). 


We see that the distribution parameters (Tyy of the predictand are 
obtained without eMiwnting the structural parameters a, cr. Instead we 
obtain unbiased and efficient estimates of ^ and directly from the 

observations (ya Pi*, t ~ ly T) by minimizing St't with respect 

to p and : (the method of least squares). Wo can thus estimate, for 
given Pthi* fl'^d the conditional mean of ?/t.i by (11); and the 

conditional variance — cr^^.. That is, we can predict yr^u without 

estimating the structural parameters a, a. 

We can also use our economic example to illustrate the experimental 
procedure A2, the use of general experiment. Structural parameters are 
estimated; from these estimates, the effect of any given structural change 
is predicted as the need arises. The experiment itself will again consist 
(in our example) in replacing the random variables pt pi'oduced in the 
free market, by fixed constants pt* (^ — 1, •••, ^)- But this time we mea¬ 
sure not the shortages directly, but, separately, the demand x\ and 
the supply x^. The relation between the single random variable x^ 
(or x^) and the predetermined variables p*, z is again like that in (2). 
We can therefore estimate the structural parameters a® by two least 
square regressions of, respectively, x^ and x^ on the predetermined vari¬ 
ables p*, z; and we estimate the structural parameters a**® from 
the regression residuals. To predict the shortage yT+i for given 
2x+,> we obtain the parameters p and and hence the parameters 
^yy, by (9), (11), (12): that is, we are able to predict the effect of 
the transformation of the original free market structure («,<r, 1, 0,) into 
the controlled market structure (a, <y, 0, 1). But in addition, we can now 
also predict the result of any other given change undergone by the origi¬ 
nal free market structure: for example to predict what happens if a tech¬ 
nological change raises some of the coefficients a® of the supply equation 
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by a given percentage; or if an expected change in tastes or in popula¬ 
tion raises in a given proportion some of the demand coefficients a'^/or, 
possibly the violence of random demand shifts etc. 

Consider now the Case B: the non-experimental situation, usual in 
economics. In this case, no observations are available except those made 
in the free market, with prices determined by supply and demand, 
and therefore depending on their random shifts u% u\. Thus for ^ — 1, 
..., T, the structure is (a, a, 1, 0). But for < = !r+ 1, the structure is 
(of. O', 0, 1). Equation (10) is valid for t — T+1, but not for earlier time 
points. Estimates of necessary, as before, to predict i/t+i from 

(10) cannot be obtained from past observations on p^*, z^) since, for 
^ — 1, T, we have — 0, and pt* is not defined. During this past pe¬ 
riod, price pt> was not fixed. Instead, it was a random variable, having a 
joint distribution with the variable (by which we shall now denote 
both demand and supply since both were equal); this joint distribution, 
conditional upon the values of the predetermined variables is, under the 
conditions of the problem, again normal. Denote by y the parameters 
of this joint distribution of-the observables a;,, p^ (that is, the set y 
consists of the conditional means and variances and covariance of 
and pt* 

Since depend on the parameters y are uniquely 

determined by the structural parameters o*, a. If the converse were 
always true, the structural parameters a, or could always be determined 
from the knowledge of y; while the parameters y of the joint distribu¬ 
tion of jpt, x^ can, of course, always be estimated from observations 
on these variables. Whether, in a particular case, the parameter sets 
a, (T (or some elements of them, e.gr‘, the coefficients of the demand 
function) are in fact uniquely determined by y, depends on the assumed 
economic theory, or “model”. For example, if in the model (5), (6), 
the set of predetermined variables z is represented by a single vari¬ 
able (say, income tax-rate z') in the demand equation, and by another 
single variable (say, rainfall z'') in the supply equation, then it can be 
shown that only one structure can be compatible with a given distribu¬ 
tion of a:, p. In such a case we say that the model makes the whole struc¬ 
ture identifiable. In some other case the model might make only a part 
of the structure—such as the demand coefficients —identifiable; or no 
single parameters might be identifiable. This does not depend on the 
number of observations in hand but entirely on the model which the eco¬ 
nomist has assumed on the basis of some previous knowledge. The 
conditions of identifiability have been given by Koopmans and 
R u b i n for an important cla;ss of cases. The concept itself was defined 
by Koopmans and has been further studied by L. Hurwicz (all of 
the Cowles Commission). In a less rigorous way economists have been 
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Aware of the problem for a long time but more especially since H a a v - 
e 1 m o pointed it out in his book Prohahility Approach to Econometrics, 

Suppose then that the chosen model is such as to make all the parame¬ 
ters of our structure identifiable. Then a and cr can be derived from y ; 
but y can always be estimated from the observations on p\ x, being the 
S3t of parameters of their distribution, hence a and cr can be estimated. 
Therefore, ^ and can be estimated, because of (9), (12); and the shor¬ 
tage y can be predicted, since its conditional mean and its variance are 
determined by (II), (12). 

Knowledge of the structure can help not only in predicting the result 
of the structural change just considered, viz., the introduction of price 
control; it can be also used to predict the result of any other structural 
change, provided the change can be spelled out as a well-defined trans¬ 
formation of the original structure (a, a, 1,0) which prevailed when the 
observations were made. Thus, in our non-experimental Case B as well 
as in the case of general experiments A2, prediction is preceded by struc¬ 
tural estimation. Then the knowledge of structure makes it possible to 
prcdi(;t the effect, not only of one given structural change (as is the case 
with specific experiments, Al), but of any well-defined structural change. 
The estimation of structure, the establishing of a theory, whether with 
or without the help of experiments is therefore not only a matter of scien¬ 
tific curiosity, it has also the practical value of providing for a number 
of future contingencies. 

The case of general experiments (A2) and the case of non-experimen- 
tal observations (B) have in common the same aim of estimating the ori¬ 
ginal structure, rather than producing the changed structure by specific 
experiments (Al). But this aim is reached by different methods. Ex¬ 
periments are common to Al and A2. In the present example, they 
call for the application of the method of least squares, which arises as a 
special case of maximum likelihood estimation. In Case Al the proba¬ 
bility density of y given p*, 2, taken at the observed point (^i,..., i/t), was 
maximized with respect to the estimated parameters, and this is equiva- 

T 

lent to maximizing— Si;? (f^he exponent of the normal probability den- 

1 

sity function considered), i.e., to minimizing the sum of squares of the 
residuals v^. In Case A2 the probability densities of the independent 
variables x^ were similarly maximized, each one separately. In the 
Case B, maximum likelihood estimates are obtained by maximizing the 
probability density not of a single variable but of two jointly dependent 
ones X, p: this is a generalization of the least squares principle. In Eco- 
nometrica 1943, Haavelmo pointed out the joint dependency of variables 
in economic models, and Mann and Wald studied the properties 
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of maximum likelihood estimates of structural parameters. At the 
Cowles Commission the method has been developed by Koopmans and 
Rubin for the estimation of all structural parameters simultaneously. 
When one or more structural equations are to be estimated separately, 
more flexible though less efficient procedures are applied, developed at 
the Cowles Commission by T. W. Anderson, Girshick and 
Rubin for the case of a single equation, and by Rubin for the case of 
several equations. All these methods include cases where the jointly 
dependent variables occur with time lags. 

The economist faces the combined disadvantages of the meteorolo¬ 
gist and the engineer. At least until artificial rain was produced a few 
weeks ago, meteorologists were not able to experiment with weather; nor 
did they need to, as they did not consider it their task to change weather. 
Engineers, on the other hand, are required to predict the results of their 
interventions with nature; but in this task they are helped by experi¬ 
ments. The economist is deprived of experiments that change the struc¬ 
ture, yet has to predict results of policies consisting in structural change. 

This picture is incomplete. Some economic policies consist, not in 
changingthe structurebut merely in fixing the values of exogenous vari¬ 
ables. Also, structural estimation may call for different methods .in 
economics, where observations cannot be duplicated; and, say, in astro¬ 
nomy where they can. The principles as well as the techniques of struc¬ 
tural estimation require much further study. 


R48um4 

Les objectifs de leconomiste sont analogues a ceux de I’ing^nieur, 
mais les donnees dont il dispose sont pareilles a celles du met^orologue. 
L’6conomiste doit sou vent estinier les effets d’un changement futur 
(voulu ou attendu) du mecanisme meme dont il tire ses donn6es, sans 
pouvoir produire auciin de ces changements. 

Soit = la demande, = Toffre, == le prix, k Tinstant L II s’agit 
de pr^dire Texcedent de demande ou d’offre (penurie ou accumulation 
des stocks) i/t+i = ““ ^+i resulterait de la fixation du prix 

par le gouvernement; la provision est fondee sur des observations suc- 
cessives aux temps t 1, ..., T. 

Supposons que pour un instant quelcbnque t, 

(1) 0!^ = ^ i(p,, i,; a-*); *8 = Zi ; J?"); 

(2) - at)8 + {p, - p* )e = 0, 



iACOB MAESCHAk 


29 ^ 

(les symboles surlign^s repr^sentent des vecteurs ou matrices et L re- 
pr^i^ente une fonction lin^aire). Ici, la distribution jointe des “chocs 
al^atoires” est normale, ind6pendante du temps; leurs moyennes 

sont z6ro; leurs hearts quadratiques moyens et la covariation forment 
la matrice 

^dd ^d8 
^dS ^6S 

les i sont des variables exog^nes telles que les conditions atmosphe- 
riques ou les taux d’impots; (s^,ze®) ™ s sont les coefficients des fonctions 
de demande et d’offre; (8, e) = (1, 0) dans un march6 libre, et = (0, 1) 
quand le prix est fixe. Les valeurs num6riques de (a, a, 8, f) d6finissent 
la '‘structure'* du marche. Instituer le controls des prix veut dire 
changer la structure de ( a, a, 1, 0) 4 (a, 0, 1). 

Cas A: lea prix peuvent etre fixes A*une experience h Vautre 

h pi*, Pt*- I>es lors, (8, c) = (0, 1) pout t = 1, T+1. Deux 

fagons de proceder sont alors possibles: 

Precede A^;. Les efFets d’un changement structurel sont pr^dits directe- 
ment sur la base de Fexperience, sans que les paramfetres structurels 
soient estimes. (Cas analogue: avions soumis ^ Fepreuve dans un tun¬ 
nel a6rodynamique). L’experience remplace les variables aleatoires 
Pt dans (1) par. les constantes pt*. Nous avons 

(3) y = + Lipi*, i,; P), t = 1, T+\\ oil v, = u\ - mJ et 

(4) p — — «“ 

Dfes lors, y a une distribution normale (conditionnelle) pour i et p* 
donnes, ay ant comme moyenno 

/Xy = i^{y|p*, i}, et ecart quadratique moyen 

(5) (Tyy ~ E{^{y — ^VV ~ ^dd H“ ^88 

L’estimation de a et a n’est pas requise! Sur la base des observations 
it/o Pt*y t = 1, T) Fonobtient des estimations “efficaces’’ des para- 

T 

mHres (Xyy en minimisant SvJ par rapport k ceux-ci (m^thode de 

regression). Sur la base de ces estimations, et pour des p*T+i> zt*i 
donnes, nous estimons pi/T+i cTyy et pouvons ainsi predire yx+i* 

Precede .dg: L’experimentation nous aide k estimer les param^tres 
structurels (a, ^j. Sur la base de ceux-ci FeiFet d’un changement struc¬ 
turel quelconque peut etre predit. (Analogue: determination et appli¬ 
cation subsequente des lois physiques). Puisque Fexp6rimentation per- 
met de substituer des constantes fixes pt* aux variables al6atoires pt 
38 
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dans (1), on pent estimer les paramfetres par la regression de oc^ 

et X* sur p*, i; et les paramfetres if, en se basant sur les residus de regres¬ 
sion (c*est-i-dire les ecarts entre ou a;* et leurs valeurs estimees). Pour 
estimer les effets d’un changement structurel dti k Tinstauration du con 
trole des prix, Ton deriverait les estimations de p et (Tw de celles de «, 

d’apres ( 4 ) et (6), ce qui permettrait la prevision de comme en Ai 
ci-dessus. En outre, Teffet d’autres changements structurels, c’est-Jb- 
dire d’autres transformations de la structure originelle (a, 0), peut 

etre estime une fois que la structure originelle elle-meme a ete estimee. 
Caa B: U<m ne dispose d'autrea observations que celles relatives au rmr^ 
che litre ok les prix pi, Pt sont determines par Tofifre et la demande. 
A Finstant t = 5 P+ 1 , ( 3 ) est encore vrai. Maisles estimations de p, (Tw, 
necessaires pour predire ^t+i d’aprfes ( 3 ) ne peuvent etre obtenues des 
observations passees de (y^, pt*, zt) puisque, quand t = 1 ,..., T, pt* n’est 
pas defini et y^ = 0 . Au cours de cette periode, pt et (== a;® = a;) sont 
conjointement distribues normalement pour Zt donne. Les paramfetres 
de cette distribution conditionnelle conjointe—appelons les 7—sont des 
fonctions de a, ^ seulement, puisque p^, Xi sont des fonctions de 
Inversement, ^ peuvent etre ou ne pas etre determines 
uniquement par 7. S’ils sont ainsi determines, la structure est dite iden¬ 
tifiable. a, ^ peuvent alors etre estimes d’aprfes les observations dept> 
Xi (f = 1, T), puisque 7 peut toujours etre estime d’aprfes ces obser¬ 
vations. Sur la base des estimations de a (= a*) et a (^(Tdd» o-ss* c^ds) 

des estimations de a et (Tw sont obtenues par ( 4 ) and ( 5 ). En outre 
(comme dans A2) une fois a, a connus, les effets de changements struc- 
turels autres que I’instauration d’un controle des prix peuvent etre 
estimes. 

Dans le cas B nous devious pr6dire I’effet d’un changement structurel 
sans que ce changement puisse faire I’objet d’une experience. Ce cas 
dcarte le precede A2, et requiert I’estimation de la structure originelle. 
Mais cette estimation ne peut pas non plus etre etayee par I’exp^rimen- 
tation comme dans le cas A^- En appliquant la methode de regression, 
en A^ et A^, la density de probabilite d’une variable aleatoire unique 
telle que y, 7^ ou x^ est undue maximum pour des valeurs fixes donnees 
de p et Dans B, une generalisation du meme principe exige que soit 
maximum de la densite simultanie des observations de deux variables 
aleatoires d6pendantes x, p, lorsque i est fix6. Dans Econometrica 
1943 , ceci fftt mis en Evidence par Ha 4 velmo, et Man et Wald y 
d^mohtr^rent les propriet^s des estimations structurelles ainsi obtenues. 
Cette methode a 6t6 developp6e k la Commission Cowles, oil elle a 6t6 
appliqu6e k des syst^mes d3aiamiques comprenant jusqu’i 11 Equations. 
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Discussion 

Mr. J. R. N. Stone commented that Mr. M a r s c h a k’s paper 
shows forcibly the importance of correct theory as a prerequisite for 
analytical work with observations. The observations do not determine 
which of a set of simple transformations of the structure is in fact the 
fundamental structure of the economy. Only with observations covering 
several different structural situations can the basic constants be deter¬ 
mined out of which structural parameters appropriate to any particular 
period can be built. 

Mr. Stone stated that he understood economic models to consist of 
equations expressing structural and not necessarily causal relations. 
Causal relationships may be found by transformation of the system 
expressing each variable in terms of all the pre-determined variables 
of the system. Mr. Stone then referred to Mr. W o 1 d’s discussion of 
recursive systems of equations,^ and indicated that if economic theories 
comprise such systems the problem of transformation would be less 
difficult. 

Mr. Tinbergen asked Mr. Marschak to give examples of what 
he meant by identification, showing when it is and when it is not possible. 

Mr. Tinbergen also asked whether the change in tax rates, which 
Mr. Marschak suggested as an example of the value of one of the two 
to be introduced, might not be considered as a change in price levels. 

Mr. Tinbergen’s third question referred to Mr. Stone’s comments on 
causal relations, stating that he believed an equation of the reduced form 
could be called only an indirect rather than a direct causal relationship. 
Mr. Tinbergen asked whether significance should be attached to distinc¬ 
tion. He illustrated his point by noting the demand equation whose 
reduced form will usually be given in the form of a sales equation 
where quantities sold are expressed as a function- of demand and supply 
factors without the introduction of price, Mr. Tinbergen suggested 
that such an equation did not represent a direct causal relationship as 
it acts in the minds of people demanding or supplying the eommodity. 

Mr. Marschak pointed out to Mr. Stone that, regarding the situation 
where these are observations under two different structures, an example 
of an experiment may be found in the use of data for prewar and war 
years; certain parameters have been constant while others have diverged. 
The problem is then to predict the result of a change in structure resulting 
from a proposed econopaic policy change. Mr. Marschak indicated liow 
Buch a'problem might be solved. 

* See these Proceedings, Volume V (The Econometric Society) pp. 1-22. 
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Mr. Marschak next took up the question of the possibility of a 
nonformal definition of structural equations, raised by Messrs. Stone and 
Tinbergen. Fundamental laws, in contrast to formally-defined structural 
equations (which are always relative to a given policy), are understood 
by Mr. Marschak to express the behavior of specified social groups, 
and also certain external circumstances (e.gr., legal rules). Mr. Marschak 
pointed out that there may be more than one system of equations for 
each social group. 

Mr. Marschak observed, in response to the questions on causality, 
that in the case of causal relations he assumed that the effect usually 
followed the cause, with some temporal lag, however short. This lag may 
be ignored if very small, and there is then no way of distinguishing 
cause from effect. Mr. Marschak thought it not of great importance 
to determine causal relations, but agreed with Mr. Stone’s consid¬ 
eration of reduced forms as causal relationships, especially when lagged 
variables are included; Mr. Marschak indicated to Mr. Tinbergen that a 
causal relation need not express a fundamental law. 

Mr. Craig stated that he liked to think of economic coordinates as 
constituting a grid, and discussed the application of an instrument from 
physics to such a grid: (given a number of conductors in a field, the situ¬ 
ation of the structure is given by the capacity and coordinates of each 
of these conductors. Bringing a unit of electricity on one of the conductors, 
the distribution of quantity of electricity and of potential is altered in 
accordance with a set of coefficients. In a grid of prices, an increase in 
the steel price will have primary effects and also secondary effects through 
the effect of a change in steel price on the steel price.)? 

Mr. Wold added to the discussion of recursive systems, pointing out 
that they may be used for prediction (1) if future disturbances may be 
assumed to the zero, and (2) if a future development is given. In the 
second case, there must be the assumption that the change does not alter 
the pattern of other parts of the system. 

Mr. H u r w i c z gave an example showing how identification is 
achieved. He added that to assure the presence of identification, assump* 
tions are required that may be made on the basis of theory. If the 
theory is incorrect, results may be vitiated all the way through. Refer¬ 
ring back to the topic of Mr. F r 6 c h e t’s paper Mr. Wold noted that 
this indicated how lack of an adequate mathematical technique may 
imply incorrectness of statistical results and forecasts. 

Mr. Fr4chet observed that Mr, Marschak has distinguished two forms 
of random events: small ones which are not mentioned in the theory 
and a single big random event which forces a complete change in the 
system of equations, 
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Mr. Fr6chet also protested the use of the least squares method. 

Mr. Marschak replied to Mr. Frechet that there must be a further 
distinction among the small causes between random variables and non- 
random variables, and suggested to Mr. Tinbergen that it would be dif¬ 
ficult to assign a probability law to tax-rates so that they might be a 
considered random. Mr. Marschak suggested a classification of exo¬ 
genous variables between the z —observable, and the u —random but 
non-observable. He noted that there are also non-measurable, non- 
random variables. 

Mr. Marschak suggested that a difficulty would arise in the application 
of the recursive method, if the time periods become small. In that case, 
it cannot be assumed that disturbances in two consecutive points of time 
are non-correlated. 



A SHORT-CUT METHOD FOR DISTINGUISHING 
BETWEEN RIGID AND DISTURBED 
PERIODICitY 

by Herman O. Wold 

University of Vpsala {Sweden) 

1. INTBODUCTORY 

When we are dealing with time series which present wave-like oscil¬ 
lations, it is of fundamental importance to find out whether the waves 
are precisely regular in the sense of an exact, ‘‘rigid^’ periodicity, or 
whether the periodicity is disturbed by random shifts in the period 
length. Considering the two cases from the viewpoint of prediction, 
it is clear that if the waves are of constant length, efficient forecasts of 
the series may be obtained for any future time point, however remote, 
while random shifts in the period length will make the series efficiently 
predictable over short ranges only. In the analysis of rigid periodicity, 
the main tool is the Schuster periodogram. Disturbed periodicity, 
first studied systematically by G. U. Y u 1 e,^ has in recent years attract¬ 
ed more and more interest in statistical research. A chief tool for the 
analysis of disturbed periodicity is the correlogram^ to use the term which 
I have proposed for the graph of autocorrelation (serial) coefficients.* 

A new approach to the problem in question will be briefly outlined 
in the present note. The approach should be regarded as a short-cut 
method, devised to give preliminary results which might serve to guide 
the subsequent application of the more toilsome methods of periqdo- 
gram and correlogram analysis. 

As set forth in some detail in § 2, the new device is based on the cor¬ 
relation coefficient r as defined by (1). Under certain simplifying assump¬ 
tions it is found that the expected value of r^. is — J if the given series 
is strictly periodic, while for sufficiently large h the expected value of 

is 0 if the periodicity is disturbed. By our device the problem of dis¬ 
tinguishing between rigid and disturbed periodicity is thus transformed 
into the problem of testing two alternative hypotheses about a corre¬ 
lation coefficient. Our test problem is essentially non-parametric; 
in fact, empirical time series present such a host of widely different pat¬ 
terns that the hypotheses about their structure cannot adequately be 
brought together into a single parameter system. 

* G. U. Yule, “On a Method of Investigating^Periodicities in Disturbed Series, 
, with Special Reference to Wolfor’s Sunspot Numbers,” Trans, Roy, Soc,, (A), 226. 

* H. Wold, A Study in the Analysis of Stationary Time Series, XJpsala, 1938. 
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The testing of correlation hypotheses is known to require a fairly 
large number of observations. Accordingly, we cannot expect the new 
criticism to be decisive unless the time series dealt with covers a fairly 
large number of waves. Now this remark is quite in line with earlier 
experience as to the difficulties of trying to find out whether periodicity 
is rigid or disturbed.* 

The material of the present note forms part of a larger project, which 
includes, inter alia, an investigation into the significance levels of the 
correlation criticism suggested. The sampling analysis is planned to 
make extensive use of artificially constructed time series (c/. illustration 
C in § 3). The project further includes a study of suitable methods for 
locating the genuine maxima and minima of a given time series, f.e., 
genuine as distinct from small, random-like fluctuations. 

I take this opportunity to express my gratitude to the Rockefeller 
Foundation for sponsoring the project mentioned by a generous grant. 
Dr, T. W. Anderson and Dr. S. Malmquist have read the 
present note in manuscript and given valuable comments. To both of 
them I extend my sincere thanks. 


2. Description of the Method 


Let x(t) denote the time series under analysis. Recording the time 
points for which the successive waves in x(t) present maxima, we ob¬ 
tain a sequence which we denote 






Now let be the distance between one maximum and the A:th prece¬ 
ding maximum, in symbols 

■= tj, I 1 /-U {v =: Ic, k 1, 7l), 

Thus prepared, let k be fixed, and form the serial correlation coefficient 
between and according to the formula 


( 1 ) 


11-k 

S — mik) — ^2u) 

*'=k 


= 





II-k 


^ (^i’+k>k 


where 


1 

^ik “ -T ~T ^ 

n — 2 k + I 


1 " 

^2k —j—: ^ 

n 2 k + 1 v.2k 


We shall now examine r^ for different types of time series x{t), 

■ See, e.gr., H. Wold, loc, cU., p, 119. Cf, also M. G. Kendall, The Advanced Theory 
of Statiaticit, II, London, 1946, p. 412. 




304 INTSilNATIONAt SfTATISTfOAL CONFEBEl^OES: isi 

On the one hand, suppose the periodicity of x{t) is disturbed in the 
sense that x(t) and x(u) are independent in the limit as t — oo. 
Fixing k sufficiently large, and writing 

tp = -f- $p, 

it is . seen that will essentially be determined by values x{t) over a 
^nnterval which is far away from tp. Hence ^p will be approximately 
independent of 

dpij tp • 

It follows that the correlation coefficient as defined by (1) will have 
an expected value near to zero, more precisely 

(2) (&-»oo). 

p On the other hand, suppose the waves in x(t) are rigid in the sense that 
x{t) is additively composed of two components, say 

= y(t) + 2 ( 0 , 

where y(t) is strictly periodic with period p, 

yif' + 'p) = yip)> 

while z(t) is irregular in the sense that z{t) and z(u) are independent in 
the limit as f — 'W —> «». On these assumptions, we may write 

tp = Tp rjp, 

where 

rp= rQ + v,p (v == 0, 1, w) 

are the time points for which y(t) has its maxima, while Vp is a random 
variable which represents the deviation in time between an observed 
maximum and the corresponding maximum of the underlying periodic 
component. By hypothesis, rjp is asymptotically independent of 
for large k, and E(r)p) = 0. Now to evaluate E(r^), we observe that the 
main term of the numerator in (1) will be 

E(’i]p ^v-.k)(^i'+k Vi') ~ ^(vp^)i 

while the denominator gives 

E(tJp Vp~y)^ = E{ljp^]^ — Vp)^ ^ 2 ^{Vp^)‘ 

For the mathematical expectation of we accordingly obtain, as a first 
approximation, 

(3) 'E{r^) S . (* > alp). 

In view of (2) and (3), the coefficients fn ms^y serve as a rough criterihn 

for deciding whether the periodicity of x(t) is rigid or disturbed. 

3. Illustrations 

A. Air temperaturey Vpsala, 1865-1945. The air temperature at 
Upsala has a yearly maximum, usually in July. Detailed records of 
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ttie maximal temperature are available since 1865. Taking from these 
records the time points tp of yearly maxima, and applying formula (1), 
we obtain 

-= -0.427, = -0.748, -0.516. 

The values approximate —1/2, thus pointing towards the hypothesis 
of rigid periodicity, as expected. The interpretation is that if the maxi¬ 
mal temperature comes early (late) one year, this has no marked effect, 
on the timing of the maximum next year. 

B. Wolfer's sunspot numbers, 1749-1941, The sunspot intensity 
presents clear cycles, where the length of the waves varies between 7 
and 17 years. In the study already referred to, G. U. Yule chose this 
phenomenon for illustrating his new statistical methods of investigating 
disturbed periodicity. Now Wolfer’s sunspot numbers present 17 maxi¬ 
ma in the period 1740-1945. Applying formula (1) to this material, 
we obtain 

r = -0.052. 

This would be in agreement with the hypothesis of disturbed periodi¬ 
city. The situation is perhaps not quite clear, however, for if we proceed 
to the distances between non-adjacent minima, we obtain 

== -0.452, rg = -0.817, = -0.778, = -0.258. 

Thus it seems that our short-cut test fails to be decisive for this material. 
It miight be added that according to the magneto-hydrodynamic theory 
of sunspots. recently developed by H. A 1 f v e n, the sunspot cycle is 
composed in two cycles, each of period 22 years.^ 

C. Artificial data. Finally, I shall report some results obtained when 
applying (1) to a series x(t) which has been constructed according to the 
formula 

(4) x(t) = 5 sin + It 

where the are independent random variables, normally distributed 
= 0, == 1). It is seen that x(t) is a series of rigid periodicity, with 

period 32. The were taken from a table of random normal deviates 
constructed at the Institute of Statistics, Upsala.® 

The series x(t) constructed contains 14,000 items. Breaking up the 
series into 25 subseries of 560 items, each subseries contains 17 or 18 

< See H. Wold and I. Qalvenius*, “Statistical Tests of H. Alfven’s Theory of 
Sunspots,” Arkiv Matem. Astron. Fys., ,34 A (1947). 

B H. Wold, “Random normal deviates,” Ttaclfi for Computers, XXV. 

39 
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maxima. For each subseries, was calculated for A; = 1, 2, 3, 4, 5. 
Next Fisher’s ^-transformation was applied. 

2k = i log (1 + rt)/(l ~ r,,). 

For each k it turned out that the resulting 25 ^u-values were normally 
distributed, with fairly good approximation. The sample average and 
standard deviation of are shown below. It is seen that the average 
values of lie close to —0,549, which is the z which corresponds with 
= —1/2. The observed standard deviations of have been gra¬ 
duated by a linear expression in k. 




^2 

^3 

u 

^5 

z^: average 

-0.521 

-0.480 

-0.512 

-0.498 

-0.534 

Zj.: stand, dev., obs. 

0.244 

0.198 

0.290 

0.335 

0.326 

z^: stand, dev., grad. 

0.22 

0.25 

0.28 

0.31 

0.34 

fiji Upper 5% level 

--0.18 

-0.14 

-0.08 

-0.04 

+0.01 

r^: Upper 1% level 

-0.04 

+0.03 

+0.10 

+0.17 

+0.24 


Next, taking z = 0.549 for expected value of z^, and making use of the 
graduated variances of 2 ]^, Fisher’s transformation was used to calculate 
5% and 1% significance levels for r^. 

It is seen that the critical levels fail to separate the two hypothetical 
r-values, —1/2 and 0. For the artificial series (4), in other words, we 
must have for our data material covering much more than 17 periods 
to be able to decide between the two hypotheses by the use of the short¬ 
cut test.® To some extent the failure is due to the method, for 
since formula (1) makes use of but one observation in each period, 
the test is not sufficient in the sense of R. A. F i s h e r. To some ex¬ 
tent, however, the difficulty lies in the problem—much material is al¬ 
ways required if we are to decide between rigid or disturbed periodicity. 
With a series like Wolfer’s sunspot numbers, for instance, I think it is 
doubtful whether any purely statistical test is able to bring out clearly, 
on the basis of the 17 cycles thus far observed, whether the periodicity 
should be regarded as rigid or disturbed. 

« Judging from similar calculations, 35 periods would give satisfactory con¬ 
fidence’ levels. 
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R48um4 

Le problfemo consiste a considerer des scries chronologiques presentant 
dcs oscillations ondulatoires, et k determiner si les ondulations ont une 
periodicite rigide ou perturb6e. L’analyse de la periodicite peutetre faite 
avec des periodogrammes et des correlogrammes; dans cette communica¬ 
tion, toutcfois, I’auteur presente une methode plus simple. 

La methode consiste k calculer le coefficient de correlation rj^, comme 
il est defini par Tequation (1), representant la correlation entre la longuer 
des intorvalles entre les maxima successifs. Dans certaines hypotheses, 
I’experance mathematique de r,^ est — J si la serie donnee est strictement 
periodiquo et 0 si la p6riodicite est perturbee. Lc probleme est done 
transforme en un probleme consistant 5, tester deux hypotheses alter¬ 
natives concernant un coefficient de correlation. 
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THE ROLE OF A STATISTICAL CONSULTANT 
IN A RESEARCH ORGANIZATION 

Churchill Eisenhart 

National Bureau of Standards {United States) 

1. The Function of a Statistical Consultant 

The function of a statistical consultant in a research organization 
is to furnish advice and guidance in the collection and use of data to 
provide quantitative foundations for decisions. For, as W. Edwards 
D e m i n g has said, “...the chief duty of a statistician is to interpret 
data in such a way that they convey knowledge for purposes of predic¬ 
tion; another is to collect data in such a way that they provide maxi¬ 
mum information; and still a third function is to help bring about some 
changes in the sources of the data. There is no use in taking data if you 
do not intend to do something about the sources of the data.*' Some 
may object that this attitude appears to be excessively pragmatistic— 
that study of the world to obtain knowledge for its own sake is an ad¬ 
missible occupation. True! But, it should be noted that the foregoing 
does not exclude description of the status-quo as a means of understand¬ 
ing it, that is, to provide a basis for predicting the outcome of any 
course of action that could be taken. And research organizations gene¬ 
rally take this attitude—they tend to agree with W. K. Cl i f f o r d that 
“Every scientific fact is a shorthand expression for a vast number of 

* Meeting arranged by the Washington Section of the American Society for 
Quality Control. 
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practical directions: if you want so-and-so, do so-and-so.” Research 
organizations in the main study the world for a dual purpose; (a) to 
determine how it can be changed; and (b) to decide which one of the 
possible worlds should be made the real one. 

The tasks of a statistical consultant as a member of a research team 
are: 

(1) To furnish advice and guidance in the COLLECTION OF DATA. 
This involves reaching agreement with the other members of the team 
on (a) what kinds of data are needed, (b) how they are to be collected, 
and (c) in what quantity. When (a) has been settled in the light of the 
objectives of the investigation, the knowledge of the workers in the sub¬ 
stantive field concerned, and whatever supplementary information is 
accessible, it becomes the lot of the statistical consultant to adapt or 
develop, alone or in cooperation with other members of the research 
team, (i) patterns for the collection of the data (designs for experiments, 
patterns for the stratification of sampling, etc.) and (ii) methods of collec¬ 
ting the data (taking measurements, drawing samples, etc.) such that 
the effects of uncontrolled factors may be expected to balance out 
with increased replication, valid adjustments can be made for known 
or likely sources of bias, and the reliability of predictions based on the 
data obtained can be adequately estimated from the data alone or in 
conjunction with supplementary information. 

(2) To furnish advice, guidance, and (on occasion) assistance in the 
PROCESSING OF DATA prerequisite to their interpretation and pre¬ 
sentation in summary form. This requires knowledge of, or better, ex¬ 
perience and skill with the procedures of statistical analysis and the tools 
of numerical mathematics. 1'he former include the procedures appro¬ 
priate to analysis of variance and covariance, contingency tables and 
goodness of fit, correlation (interclass and intraclass; simple, multiple, 
and partial; normal, serial, and rank), estimation by a single value 
(method of moments, maximum likelihood, ‘‘close”) and by intervals 
(confidence intervals and fiducial limits), fittmg frequency curves and 
their integrals (logits, probits), graduation and smoothing, least squares 
and regression equations (simple, multiple, and partial; linear and 
curvilinear; orthogonal polynomials), oscillatory time series (Fourier 
series and periodogram analysis; autoregressive series and correlogram 
analysis), rejection of observations, tests of significance (single-, double-, 
multiple-, and sequential-sampling; parametric and nonparametric); 
and so forth. The tools of numerical mathematics include computing 
machines, tabulating machines, mathematical tables, nomograms, and 
other aids to computation that can make arithmetic less burdensome, 
if not yet a pleasure. Clearly no man can be thoroughly acquainted, 
experienced, and skilled with all of these procedures and tools. But 
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there are times in the life of a statistical consultant when he wishes 
that he were! 

(3) To furnish advice and guidance in the INTERPRETATION OF 
DATA, and the PRESENTATION OF DATA as supporting evidence. 
This involves (a) knowledge of the data (especially, how they were collec¬ 
ted) and the objectives of the investigation, (b) some experience with 
data in the substantive field concerned, and (c) use of the mathematical 
theory of probability to determine with what confidence predictions 
of a given type can be made from data collected in a specified way and 
analyzed in a prescribed manner. It also requires (d) knowledge 
and experience in the presentation of data as evidence in tabular or 
graphical form; by averages, measures of dispersion, regression equations, 
etc.; by the representation of nature by probability distributions involv¬ 
ing parameters that can be estimated from the data; and so forth. 

The special contributions of the statistical consultant are his use of 
the mathematical theory of probability to determine what conclusions 
can be drawn and with what confidence, and his skill and experience in 
the presentation of data as evidence. The statistical consultant, in 
turn, is guided by the rule first stated explicitly, to my knowledge, by 
Walter A. Shewhart: “Original data should be presented in a 
way that will preserve the evidence in the original data for all the pre¬ 
dictions assumed to be useful.’* This implies that if the data are pre¬ 
sented in condensed form then their summary should not tend to “cause 
human action significantly different from what this action would be 
if the original [data] had been taken as a basis for evidence”—at least, 
so far as the set of “all the predictions assumed to be useful” is con¬ 
cerned. However, this raises the question: what is the set of “all the 
predictions assumed to be useful”? The answer appears to be: “We 
cannot have facts without some theory.” 


2. Making^Use of the Statistical Consultant 

(1) As a collahorator in planning the procedure to he followed in an 
experiment, test, or survey. 

The cardinal rule for making effective use of the statistical consultant 
is 

Call in the statistical consultant at the planning stage of an investiga¬ 
tion. This rule is appreciated in the United States more widely today 
than formerly. Its importance derives from the fact that the decisive 
step in every investigation is the collection of the basic data: what data 
are collected is determined by the objectives of the investigation, and 
in turn determines its scope; how the data are collected determines the 
character of the predictions that can be validly based upon them. 
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Too often in the past the statistician has been called in ‘‘to the rescue*’ 
after difficulties have been encountered in the interpretation of the data 
—difficulties that could have been foreseen and avoided by appropriate 
planning of the collection of the data. In such eases, it is often impossible 
to draw any worthwhile conclusions from the data, with confidence. 
Sometimes a few results can be salvaged, but at great cost and with 
some risk. Cases in point are conclusions reached by analysis of vari¬ 
ance when there are disproportionate frequencies in the respective 
classes: the arithmetic is almost certain to be heavy and the conclusions 
reached may depend on assumptions that have to be made in selecting 
the method of analysis—assumptions that cannot be checked from the 
data. 

It is when the statistical consultant is called in at the planning stage 
that he can be most helpful in the processing and interpretation of 
data. 

(2) As an informal coordinator of the techniques of research. 

The statistical consultant performs another function, of supplementary 
nature, as he pursues his various tasks in the performance of his primary 
functions: the statistical consultant becomes an informal coordinator 
of research, drawing to the attention of workers in one branch of the 
organization related research completed, in progress, or contemplated in 
another branch—research which, as Warren Weaver put it, “involves 
the same verbs but different nouns.” The statistical consultant is 
one of the means whereby techniques that have proved useful in one 
branch of science can be carried over and find useful application in 
other branches of science. 

3, “Student”, the Fatheb of Statistical Consultants 

In an address before the Royal Statistical Society in December 1934, 
R. A. Fisher stated that he found himself “more and more strongly 
drawn” to the opinion that 

“... the essential effect of the general body of researches in mathematical sta¬ 
tistics during the last fifteen years is fimdamentally a reconstruction of logical 
rather than mathematical ideas, although the solution of mathematical problems 
has contributed essentially to this reconstruction.” 

In his Harvard Tercentenary address he offers the following as an ex¬ 
planation of the delay in reaching this state of affairs: 

“Exact solutions of all the more important and immediate problems were possi- 
' ble by analytic methods certainly within the capacity of the greater writers of the 
last 160 years. That their existence remained for so long imknown, can only, I be¬ 
lieve, be explained by the absence of any steady conviction that inferences invol¬ 
ving an element of uncertainty deserve anything better than rough and approx¬ 
imate discussion.” 
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It is my opinion that what he mentions undoubtedly had a retarding 
effect but that the following explanation is closer to the mark: For 
19th century physical science the Classical Theory of Errors and Method 
of Least Squares were good enough. It was the advent of, study of, 
and experimentation with, first biological and later industrial material, 
subject to great and diverse forms of variation, that brought the need 
for statistical theory and methods of greater scope and effectiveness. 
And finally, given the need, the required ideas and methods were not 
forthcoming until perspicacious men of statistical inclination and mathe¬ 
matical bent were given an opportunity to don overalls, or at least 
laboratory frocks, and work side-by-side with those who were grappling 
with the problems to be solved. 

The man who first clearly conceived the role of a statistical consultant 
in a research organization was William Sealy G o s s e t, employed as a 
Brewer by Messrs. Guinness of Dublin, and endeared to statisticians 
throughout the world as “Student”, the pseudonym under which he 
published his far reaching contributions. Of “Student,” his distin¬ 
guished disciple R. A. Fisher has said: 

“How did it come about that a man of ‘Student’s’ interests and training should 
have made an advance of fundamental mathematical importance, the possibility 
of which had been overlooked by the very brilliant mathematicians who have stu¬ 
died the Theory of Errors? Of his personal qualifications the most obvious are a 
clear head, and the practice of forming independent judgments.... One immense 
advantage which ‘Student’ possessed was his concern with, and responsibility for, 
the practical interpretation of experimental data. If more mathematicians shared 
this advantage there can be no doubt that mathematical research woidd be more 
fruitfully directed than it often is.” 


Resume 

La fonction d’un consultant en statist!quo dans une organisation 
de recherche est d’etre conseil et guide dans la mani^re d’obtenir des 
donn6es numeriques et dans la fa 9 on d’en faire usage comme base quan¬ 
titative de decisions. Cela iraplique la nece8sit6 de se mettre d’accord, 
avec les autres membres du groupe engages dans la recherche, sur les 
trois points suivants: 

(a) la nature des donnees requises; 

(b) la fa 9 on d’obtenir ces donnees; 

(c) la quantity de donnees. 
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Les contributions particuliferes que peut faire le statisticien consistent 
dans son savoir et son experience dans la fa 9 on de recueillir d’inter- 
pr6ter et de presenter les donn^es comme materiel d’6vidence, et dans 
Femploi du calcul des probabilites pour determiner quelles conclusions 
on est k meme d’en tirer et quel est le degre de confiance que Ton peut 
attribuer k ces conclusions. II est avantageux de recourir au service 
du statisticien dfes le debut c.4.d., lors de Tetablissement du plan dc 
recherche. Souvent le statisticien remplit la fonction d’un coordon- 
nateur de recherche dans ce sens que les methodes ou techniques jugees 
utiles dans une branche de recherche, par son intermediaire, sont trans- 
plantees dans une autre branche ou elles se pretcnt des applications 
fructueuses. 


Discussion 

Mr. B e 1 z asked what statistical instruction is given to engineers 
in United States universities. He described the introductory work which 
is given in Australia, where engineering students are taught the possi¬ 
bilities of using probability theory and the principles and methods' of 
quality control and simple experimental design. 

40 



EXPERIMENTAL ^EsIgN PRINCIPLES IN 
INDUSTRIAL RESEARCH 

by George W. Brown 
Research Professor, Statistical Laboratory, 

Iowa State College (United States) 

Introduction 

Research, in this paper, is not confined to professional research groups 
or sections, but is taken in its broadest possible sense. Thus, the steps 
taken in initiating quality control procedures in a given process constitute 
research. Similarly, we use experimental design in a broad manner to 
cover systematically planned investigations, even when the origin of 
the data may not be experimental, so long as there is a sampling design 
based on a classification of sources of statistical variability. 

The basic principles of experimental design, as laid down by F i s h e r 
and his followers, have become firmly established in the fields of agri¬ 
cultural and biological research. Industrial research has, on the other 
hand, been slow to take full advantage of these principles, partly because 
industrial workers do not have the same incentives to publish that aca¬ 
demic workers have, and partly, perhaps, because industrial research 
is often an incidental part of an industrial executive’s major operating 
duties. In some industries, also, executives may be frightened by the 
word ‘ ‘experimental.” 

The purpose of this papen is to present a general picture of the field 
for experimental design in industrial research, without attempting to 
compare the relative merits of specific designs in specific applications. 
Several widely differing phases of industrial activity will be considered, 
one by one, as candidates for the application of experimental design 
methods. 


General Principles 

Experimental design starts with the classification of possible sources 
of statistical variability in one or more attributes, and generally leads 
to estimates of effects on the attributes in question, to estimates of the 
error of estimate, and to reclassification or search for further sources 
of variability. The goal of the design is to provide maximum information 
at a reasonable cost. It is generally the case that efficient designs lead 
to fairly simple analysis and interpretation of data, as a result of balances 
or orthogonalities inherent in the designs. The design is deliberately 
chosen to exhibit certain effects, in spite of other unavoidable distur¬ 
bances to which the data are subject, and to pool, or confound, certain 
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effects wliose separate estimation is not required. It is evident that 
these goafs are not peculiar to agricultural research, and there is a grow¬ 
ing body of experience in industrial applications to testify to that fact. 


Initiation or Sampling Inspection Plans 

The impetus of the late war has led industry to wholesale adoption 
of sampling inspection plans in the form of standard quality control 
procedures. Some companies now apply quality control methods through¬ 
out a plant process, from receiving department to shipping department. 
The initial steps in adopting such plans almost always involve research 
investigations to determine the magnitudes of “within lot*’ and “between 
lot” variation, thus providing opportunity for the application of experi¬ 
mental design methods. Some applications have been made here by engine¬ 
ers and others, originally unversed in statistical methods. These men have 
been attracted by successes obtained with the relatively simple quality 
control procedures and have been led to investigate the more sophisticated 
statistical techniques which make possible earlier and more intelligent 
application of the routine methods. In fact the whole problem of whip¬ 
ping an industrial process into “control” is a problem of locating sour¬ 
ces of variability, finding the important ones and then taking action. 
Systematic investigation may be much more efficient than a blind attempt 
to reduce all variability everywhere to negligible size. It is important 
to realize that experimental designs need not interfere with normal pro¬ 
duction, since good design principles may often be met by a sampling 
design, without adopting experimental methods throughout, although 
planned experiments should not always be ruled out. Wherever sampling 
inspection is to be undertaken as a routine, there is an opportunity to 
apply experimental design methods. Take material which is to be ins¬ 
pected in a receiving department, and suppose that it is classified by lots, 
and by cases within lots. It is clear that more efficient inspection proce¬ 
dures can be imposed with a knowledge of the expected variability within 
cases and by case within lots, and by lot. If the material within cases is 
relatively homogeneous one would expect to take advantage of that fact 
by not sampling excessively within any individual case. This offers a 
beautiful opportunity to apply efficient statistical techniques, particularly 
when a single vendor is to supply similar material over a period of time. 

It might also be mentioned that procurement of raw materials may 
be aided by planned investigations. Take the case of a plant which 
processes an agricultural product to extract a valuable oil. The oil 
content of the raw material is highly variable, and will depend on genetic 
factors, where grown, etc. In this situation a relatively small amount 
of well-planned investigation may repay its initial cost many times over. 
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Paogsss Impbotemisnt 

Research into process improvement has so far furnished perhaps most 
of the industrial applications of design principles. Investigators have 
used Latin squares, involving n operators, n machines, and n different 
products; there have been textile applications with randomized blocks 
and Latin squares. Perhaps the analogy with agricultural experimenta¬ 
tion is more obvious here, where the object is to maximize the yield of a 
process, or the quality of output, and where a number of factors may 
enter. Perhaps, also, the possible gains to be derived from investigation 
are more obvious to plant management. There is hardly an industry 
which is not concerned with process improvement. 

It is interesting to note the possible effects of studying lot to lot varia¬ 
tion and within lot variation on research in process improvement. Such 
studies often turn up the key to better quality. A wartime study of a 
certain explosive led to improved quality by uncovering excessive varia¬ 
tion which could be due only to improper packaging. In this particular 
case it was found that varying storage times and conditions brought 
about heterogeneity in material which was originally relatively homo¬ 
geneous. 


Laboratory Besbarch 

In these days research laboratories are maintained by large corporations, 
often for prestige value as much as for the actual output of the research 
group. In any serious research group, however, there are usually many 
opportunities for the application of experimental design techniques. 

Take first the refinement of measuring techniques. Anybody who has 
ever subjected precision measuring equipment to searching investigation 
has discovered that they are subject to all the variability one can think 
of, and more. Precision.techniques are normally sensitive to operator 
differences, day to day fluctuation, differences in type of material 
measured, etc. In industrial laboratories, the precision equipment is 
rarely as good as is claimed for it, unless considerable effort is expended 
on testing. Such matters as number and spacing of readings, frequency 
and method of calibration, depend on intimate knowledge of the behavion 
of the equipment. It is this author’s opinion that many users of so-called 
precision equipment are not sufficiently conscious of the vagaries of such 
equipment. It is customary to assume that the equipment errors are 
small relative to the variability in the material under test. This may 
be true only when the equipment is used in the optimum manner, or 
when suitably modified. 

Other applications in laboratory research may be similar to the appli- 
catimis in process improvement, A laboratory attempts to create new 
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products with certain desired characteristics, with certain factors availa¬ 
ble as variables. In work based on a theoretical background there may 
be foundation for adopting theoretical shapes for response curves of one 
kind or another. In such cases, additional premiums are available for 
good design, making possible more efficient partition of the degrees of 
freedom of the experiment. 

Other laboratory research may be concerned with consumers’ use and 
maintenance of the company’s product. The advantages of good experi¬ 
mental design are obvious here. Take, for example, a company which 
markets food products. Such companies frequently engage in research to 
develop new recipes and improve old ones, in order to encourage use of 
their product. The sensitivity of cooking recipes to various treatment 
times and quantities of ingredients, and the variability of people’s tastes 
and judgments is well known. The efficient experimenter in this situa¬ 
tion makes full use of the experimental design methods. 

Other Industrial Research 

Research activities not previously classified include marketing and 
advertising research, and miscellaneous research problems such as the 
evaluation of the effects of training programs. 

Marketing and advertising research are primarily dependent on the 
techniques of survey sampling, which in turn are based on experimental 
design principles. In these fields several research groups are active 
in applying up-to-date techniques to survey investigations. These fields 
also offer some interesting experimental possibilities which are normally 
not applied because of the understandable reluctance to experiment 
with “good will.” 

The evaluation of alternative training programs offers a field which 
so far as this author knows, is not widely exploited at the present time. 
The present interest in training methods, in large companies of all kinds, 
seems to indicate that some of these companies must soon begin to im¬ 
prove their methods of evaluation. The obvious questions of how much 
training, how long, and the related problems of selection of trainees can 
be answered only through well planned experimental work, which need 
not be large scale experiments. Some of the work done by and for the 
armed services during the war were very closely related to this industrial 
problem. 

Conclusion 

The reader can no doubt supply other examples, or classifications 
of applications not mentioned here. The important point here is not 
the difference in applications, but the degree of sameness. Stripped 
of the special cloak going with the specific application, the same goals 
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remain, to obtain the maximum useful information with minimum effort, 
on the basis of classifications of sources of variation. The principles 
remain the same, the basic tools of good designs are the same, whether 
the investigations involve soy beans or automobiles. 


Resume 

L’auteur traite les applications possibles des methodes de plans 
d’exp6riences (experimental design) dans le domaine de la recherche 
industrielle, dans un sens assez large. II donne un aper 9 u general, sans 
discuter des applications pratiques speciales. 

Bien que les principes fondamentaux des plans d'experiences aient 
ete solidement 6tablis dans le domaine del a recherche agricole et biolo- 
gique, ils ont 6te beaucoup moins admis dans les applications indus- 
trielles. En principe, toutefois, les conditions favorables k Tapplication 
de ces theories ne sont pas limitees k la recherche agricole ou bio- 
logique. 

L’introduction d’un programme de controle des fabrications est con- 
sid^r^e comme une excellente occasion d’appliquer les methodes des 
plans d’experiences, en proc6dant k des investigations systematiques 
des sources de variation, afin de raccourcir le temps n^cessaire k mettre 
les precedes de fabrication sous controle. Dans ce cas, le plan d’experi- 
ences ne sous-entend pas des methodes experimentales, car les conditions 
de la theorie peuvent souvent etre satisfaites par une methoeje d’echan- 
tillonnage appropri^e de la production courante. 

La recherche en mati^re d’am61ioration de proc6d6s de fabrication 
a d6j4 donne lieu k de nombreuses applications, peut-etre parce que 
Tanalogie avec Texp^rimentation agricole est plus apparente ici. Dans 
la recherche de laboratoire, Tam^lioration de techniques de .mesure 
presente, de meme que les recherches concernant 1’utilisation des pro- 
duits par les consommateurs, une bonne occasion d’application des 
methodes de plans d*exp6riences. 

Parmi d’autres applications mentionn^es par Tauteur, une possibilite 
int6ressante semble etre revaluation de programmes d’entrainement 
de personnel ainsi que le probl^me connexe de la selection des candidats 
pour I’entrainement. 



I^TATII^TICAL OUALltV CONTROL IN 
AMERICAN INDUSTRY 

by William R. Pabst, Jr. 

Quality Control Division^ 

Bureau of Ordnance Department of the Navy 
{United States) 

Statistical quality control^ is beginning to make a unique contribu¬ 
tion to American industry. Over a wide area it is bringing the logic 
of modern statistics to bear on the day-to-day problems of the factory 
and assembly line. The testing of product qualities during production 
constitutes a type of continuing experiment in which sources of varia¬ 
tion can be identified and eliminated if necessary. The Shewhart 
Control Charts, whether used on a single machine, a manual operation, 
or on a complicated assembly, embody in simplified pictorial form sta¬ 
tistical tests of significance. Simple as these charts are, their use in¬ 
volves fundamental changes in concepts in the relation of engineering, 
production, and inspection. 

Control charts are of two main types; first, charts for variables, known 
as ''x and R charts*’; and second, charts for attribute qualities, known as 
“p charts’* for fraction defective and “c charts” for defects per unit. In 
X and R charts, the averages of samples taken usually at fixed intervals 
of time and the corresponding ranges or standard deviations are plotted^ 
From accumulated data on ranges from successive samples, control li¬ 
mits based on the standard error of the mean are assigned about the 
averages. The control limits provide a graphic test, analogous to the 
analysis-of variance,^ of the sub-lot to sub-lot variance in comparison 
with the within sub-lot variance for the past data; these limits are pro¬ 
jected into the future as a means of detecting any changes in population 
• from which the successive samples are drawn. Control limits for 
ranges or standard deviations provide a graphic counterpart of B a r t- 
1 e t t’s test for past data. In p and c charts, in which estimates of the 
mean and standard deviation are related, only sample percentage or 

» See W. A. Shewhart, Economic Control of Quality of Manufacttired Product, 
D. Van Nostrand Company, New York, 1931. Also 

Fugene L. Grant, Statistical Quality Control, First Fdition, McGraw-Hill Book Com¬ 
pany, Inc., New York and London, 1946. 

* K. A. Brownlee, Industrial Experimentation, Directorate of Royal Ordnance 
Factories, Ministry of Supply, London, His Majesty’s Stationery Office, 1946; and 
Henry Scheff6, “The Relation of Control Charts to Analysis of Variance and Chi- 
Square Tests,” Journal of the American Statistical Association, Volume 42 (1947), 
p. 426. 
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number of defects is plotted and control limits are derived from accu¬ 
mulated averages. 

Control charts may serve broader purposes of comparison when a pro¬ 
per selection of rational sub-groups is made. Control charts on each of 
two or more similar machines on the same operation provide a simple 
model for assigning variability as between operator and machine. Con¬ 
trol charts also make possible a comparison of the intrinsic variability 
of machines or process with the specification tolerances and also a deter¬ 
mination of the readiness of stand-by equipment. Modified control 
limits, deriv^ed from the subtraction of the appropriate standard error 
multiple from tolerance limits, furnish a continuing basis for the com¬ 
parison between process variability and specification tolerances provided 
the underlying distribution is known. 

Like all statistical tests, control charts may be used for a variety 
of purposes. They may be used, in the form of x and B charts, for control 
of a particular machine or group of machines. Percent defective and 
defects-per-unit charts may be used to evaluate the results of a compli¬ 
cated assembly operation such as building a radio chassis or filling a mail 
order package. Control charts may also be used to evaluate incoming 
product whether raw material or complex final product or sub-assembly. 
The closer statistical evaluation is to the process, the more rapidly can 
corrective action be taken when found necessary. Machine control 
charts make possible almost immediate action to correct process, where¬ 
as control charts us^ for evaluation of purchased product, as in accep¬ 
tance inspection, may have delayed effect on processes exercised only 
through lot rejection or contract cancellation. In all these cases, the 
purpose of the statistical quality control chart is the test of the null 
hypothesis that the characteristics of the product or process under ob¬ 
servation have not changed nor departed from satisfactory limits. 

Well-developed statistical quality control installations include at* 
least three features of quality evaluation; namely, evaluation of incom¬ 
ing material by means of acceptance sampling plans, evaluation of ma¬ 
chine process or assembly by' means of control charts, and evaluation 
of the quality of the outgoing product by means of sampling plans and 
attribute control charts. Control at one point on a process tends to 
show the desirability for control at many others. In an integrated 
company, control'over the quality of the outgoing product of a given 
plant is usually of first consideration. Effective control of the final 
product imposes process controls at the intermediate stages of the pro¬ 
cess. Process controls imposed at strategic points tend to require ad¬ 
ditional controls on |»eviou) operations. Finally, control of incoming 
materials is required in order to ensure satisfactory quality level for 
further processing as well as for reasons of economy. 
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Acceptance sampling plans used both for acceptance of incoming 
material and for check inspection of outgoing product are based upon 
a classification of defects for the item and upo i a structure of sampling 
plans. Quality control generally requires a more exact definition of 
product than is furnished by drawings and specifications. No matter 
at what place the production or process is to be evaluated, the primary 
step is the specification of what is to be measured, gauged, or judged 
and the weight that is to be applied in summing the quality of the end 
product. This is customarily given in the classification of defects for 
end product which is based on tolerances, finishes, and so forth for each 
part. The classification of defects translates the drawings and speci¬ 
fication into a form upon which inspection procedures can be based. 
Each possible departure from drawing requirements is classed according 
to importance as judged by design engineers and as verified by labora¬ 
tory test and production experience. Generally a fourfold classification 
of defects into Critical, Major, Minor A, and Minor B categories is used, 
and this is typically available to the suppliers of material. Sampling 
plans in widest use are the Dodge-Romig tables^ and the Navy Tables.^ 
Each of these provides a structure of sample sizes and acceptance and 
rejection numbers for given lot sizes and for various sampling risks. The 
Dodge-Romig Tables are indexed by Average Outgoing Quality Level 
(AOQL) and by Lot Tolerance Percent Defective (LTPD), whereas 
the Navy Tables are indexed by Acceptable Quality Level (AQL). The 
practice is becoming more common of including lot acceptability stan¬ 
dards either in specifications or in purchased contracts. Indeed, some 
contractors have refused to accept orders from major companies until 
the lot acceptability levels and the classification of defects were estab¬ 
lished. 

Such standardized acceptance inspection, based on quality control 
principles, has ramifications for both government and industry. Stan¬ 
dard inspection tends to create a uniform evaluation of material making 
the anchor stamp, laboratory seal of approval, and similar designations 
capable of interpretation by those to whom material flows. In the future 
these stamps may be accompanied by the quality level at which material 
has been inspected. When this has been accomplished duplicate ins¬ 
pections at each handling of product may be avoided and the labor of 
re-inspection and wastage of materials can be eliminated. Standard 

* Harold F. Dodge and Harry G. Romig, Sampling Inspection Tables, John 
Wiley & Sons, Inc., New York, 1944. 

^ General Specifications for Inspection of Material, Standard Sampling Inspec-- 
tion Tables for Inspection by Attributes, U. S. Government Printing Office, Wash¬ 
ington, D. C., April 1, 1946. 
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inspection also makes it possible for those who purchase part of their 
requirement from others and make part of it in their own shops to have 
nearly identical inspection of own and purchased product at the 
same quality level. This implies, too, that government evaluation 
inspection is a necessary function even in its own plants and is not 
solely for the purpose of policing private producers. 

Machine control chart usage varies more than that of acceptance 
sampling plans. Some companies aim to establish a “chart on each 
machine.” Others use charts only at points of strategic importance 
or when trouble is apparent. However, the tendency is to utilize 
charts at those points where critical or major defects (as shown by the 
classification of defects for the product) are affected, especially when 
the product is made in a company owned plant. Such controls on stra¬ 
tegic points of process can also be suggested to suppliers. Some compa¬ 
nies claim to have found it profitable to instruct their suppliers in statis¬ 
tical quality control methods. When machine control charts are used, 
exact specification of measurement and allowable tolerance in each 
operation must be provided. This, as well as the classification of 
defects, is the work of the design engineer. Design expectation can be 
checked against production experience by comparing machine varia¬ 
bility and setting with tolerance limits. The installation of machine 
control charts on the manufacture of an item usually involves recon¬ 
sideration of many of t)ie specification details. This careful review of 
the specifications generally results in a relaxation of many more tole¬ 
rances than need to be tightened to meet established performance re¬ 
quirements. 

Actual practice in the construction and maintenance of control charts 
varies widely. Some companies have established the general practice 
of using a sample of five for variables charts and relating frequency 
of inspected sample to production levels. Others use various sample 
sizes. In some cases the American War Standards® are followed 
closely. However, most companies use modified control limits for 
process charts and some use chart control limits and modified limits 
together.® Modified limits (in the British sense) are found to be useful 
in shop work and in case of intermittent production. In these cases 
chart forms with precalculated modified limits are customarily sent to 

* Control Chart Method of Controlling Quality during Production, American War 
Standard ZI.3-1942, American Standards Association, 70 East 45th Street, New 
York, 1942; axidOuidefor Quality Control and Control Chart Method of Analyzing Data, 
American War Standard ZI. 1-1941 & ZI.2-1941, American Standards Association, 
70 East 45th Street, New York, 1941. 

• E. H. Sealy, A First Guide to Quality Control for Engineers, Ministry of Supply, 
London, 1943. 
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the operation with shop drawings and other instructions. The charts 
provide a means by which the quality control inspector can start imme¬ 
diately with the plotting of points in checking of product against speci¬ 
fied requirements. 

In many applications of machine control charts, the procedure has 
generally been to secure control over one operation of importance. 
For example, in axle manufacture, a first attempt was made to eliminate 
the variation in shim required between the drive shaft and the carrier 
housing. To do this closer control of the mating pieces was needed and 
control over these was secured only by extending charts to approximately 
one hundred other dimensions. Each of these involved some changes 
in shop practices and in specifications.’ The resulting product, made 
at a great saving in inspection time and rework, came from the coopera¬ 
tion of the engineering production, and quality control departments. 
Other applications also illustrate the tendency of controls at one point 
to reverberate throughout the system. Once the concept of statistical 
quality control has been thoroughly implanted for high levels in an or¬ 
ganization, the need for quality evaluation throughout the entire process 
becomes recognized and the chain of control through the plant becomes 
extended. 

Fundamental changes in design engineering, production, and inspection 
practices arc usually found to be desirable with the installation of a 
comprehensive statistical quality control program. Many of the changes 
originate in the systematic organization and interpretation of infor¬ 
mation about the production processes and the checking of these against 
design requirements. Just as in the laboratory where the statistical 
adviser raises questions of technical people, the answers to which help 
the technical people solve their own problems, so the quality control 
engineer in requiring a systematic flow of information helps the techni¬ 
cal staff coordinate its functions more fully. 

The point has been made that the design engineer has the respon¬ 
sibility for preparing classifications of defects and for setting standards 
and tolerances for each dimension of piece parts required in the function¬ 
ing or use of the device. Statistical quality control makes it possible for 
the production and inspection people to tell whether the process and 
machines specified can hold the design tolerances at economic cost and 
whether the sequence of such tolerances is proper. Many practical 
quality control men speak of having changes in tolerances on first 
operations affect vitally tool wear and possible tolerances on later opera¬ 
tions. As the chain of control on a process is established, the necessary 

’ “Statistical Quality Control,” Timken Axle News, Volume 15, No. 2, 1947, 
published by Timken-petroit Axle Compcuiy, Detroit, Mich. 
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working limits on cutting and grinding in order to achieve necessary 
final surface dimensions can be worked out from experience. Conven¬ 
tional tolerances on many operations are found to be unworkable, un¬ 
economic, or uncoordinated with other design requirements. All this 
brings the design engineer into more intimate contact with the operations 
in the shop, and with the verification of those operations in inspection. 
The crux of the system is to make the design engineer responsible for the 
complete specification of product, including the classification of defects 
and aceeptable quality level, and it is generally not easy to make the 
design engineer accept this responsibility. 

Upon specification of the product, the inspection department under¬ 
takes the responsibility to measure the degree to which success has been 
accomplished. In this respect the inspection department becomes the 
agent of the design engineer in ascertaining that the design has been 
successfully achieved in production. Inspection thus is allied with the 
evaluation or production process and not with the improvement of pro¬ 
duction through screening inspection as has been too often the conception 
of inspection in the past. Screening inspection, when . necessary, is 
required largely as a production function for bringing production up 
to necessary quality levels. Often screening inspection is checked for 
accuracy (based on the specification of the work unit of the screening 
operation involved) by means of sampling inspection. This changing 
attitude toward the inspection function as the evaluator of quality rather 
than the improver of quality is probably one of the most important con¬ 
sequences of the adaptation of statistical quality control. This concept 
has ramifications with respect to government inspection since it is 
becoming recognized that evaluation inspection by the consumer, whether 
it be government or a private company, has its purpose in comparison 
of product with standards set. Government inspection and adequate 
private inspection serve the same purposes. 

Production functions in the plant are also reformulated once the speci¬ 
fications of successful production are set knowledgeably by design 
and enforced by inspection. Information derived from the evaluation 
*of production is of vital interest in directing production process toward 
the successful accomplishment of the quality goals. Production accom¬ 
plishments are related in meeting not only quantity standards but also 
quality specifications. That this is new is typified by the scrap-piles 
subject to disposal by plant salvage committees in the past, and the faet 
that production was allowed to continue in the absense of carefully 
specified goals and adequate means for evaluation of the process. 
Quality control in operation generally has made it possible to cut down 
ther amount of scrap to very low limits and in some plants to entirely 
re move salvage departments. The reduction in scrap, although a tangible 
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achievement, should not be considered as a major goal of quality control 
but as a minor derived benefit from better coordination of plant 
functions. 

Coordination by management becomes easy when the primary plant 
functions are shown to be intimately related to production evaluation. 
The testimonial of each installation of quality control attests to this 
coordination. The' following remark is typical: “A direct result of 
the introduction of the new methods has been the closer coordination 
of -the function of the Inspection Department and the Production De¬ 
partment. Definite improvement in relationships is evident and ins¬ 
pection work is no longer thought of as a necessary evil but considered 
to be an inherent part of the manufacturing process.”® 

Many other changes in plant operation and plant practices may be 
found to be necessary after application of statistical quality control. 
Shop practices, such as the age old custom of producing to the basic 
dimension where a unilateral tolerance is specified becomes subject 
to reinterpretation under quality control. The unilateral tolerance 
has generally been related to making pieces of the “big” side since they 
could be cut down if necessary without wastage of the piece part. This 
however, is a holdover from the days of selective assembly. With ade- 
toquaach minery and with the help of quality control, it is found better 
to make the dimension within necessary tolerances as the first processing 
of the piece. The general policy found satisfactory under quality control 
is to use the middle of the tolcrence range as the aiming point. 

Additional gains from coordinated systems with statistical quality 
control are derived from dependence upon sample average rather than 
individual piece. When a machine is just capable of meeting tolerances, 
and individual measurement of pieces taken from a machine are relied 
on, chance high or low pieces tend to cause constant readjustment of the 
machinery. Frequent adjustment tends to cause the appearance of 
scrap whereas appropriate evaluation of the process can aid produc¬ 
tion of satisfactory material without down time for machine adjustment. 
One commercial company is reported to hav^e extended the average 
time of machine adjustment from 20 minutes to 6 hours by this disregard 
of the individual piece and to have reduced its scrap by a large percentage. 
This disregard of the individual piece in favor of the average of a sample 
is probably the most difficult fundamental of staitistics for the practical 
man to master. 

These gains from clearer recognition of mutually interdependent func¬ 
tions within a producing company or organization give statistical quality 

» “Report of Statistical Quality Control at Naval Torpedo station, Alexandria, 
Virginia,” October 7, 1946 (unpublished). 



326 international statistical conferences; isi 

control its greatest impetus. But they also tend to impose restrictions 
on its widespread and systematic application. Since it influences every 
activity in an organization, it cannot easily emerge from low levels in 
one of the existing departments but must have the full support of manage¬ 
ment. Piecemeal applications, despite the tendency of control to spread 
to prior operations, run into the stone wall or tacit opposition on the 
part of those who have not fully comprehended the system. For this rea¬ 
son many people at low levels in company organization have found it diffi¬ 
cult or impracticable to apply the training derived from quality control 
courses. In many cases partial and inappropriate applications of control 
resulting in failure have been discarded after trial. On the other hand, 
even when management has accepted the principle of using statistical 
quality control, applications have not always done justice to the 
potential of the system. Many such systems simply provide for a 
review of screening inspection data without real benefit of statistical 
methodology. The elusive term “quality contror’ has so many possible 
facets of meaning that many have been led to feel that if they were 
paying any attention to factors affecting quality of product, as in painting 
machinery and sweeping benches, they were utilizing this effective 
new tool of control. Statistical evaluation may show many of these 
auxiliary aids to quality to be necessary, but they in themselves fall 
far short of an application of quality control. 

Sales departments have not been slow in organizing advertising 
campaigns around the words “quality control” whether or not any 
application of the statistical techniques of quality control are utilized. 
Moreover, gauge companies have not been free from blame for they have 
tended to associate quality control with the use of their gauges. This 
makes it extremely difticult to find out who is and who is not actually 
using statistical quality control in practice. It also points out the 
dilemma of the American Society for Quality Control as to the direction 
of its efforts, either toward selling management on general principles 
or on development of universally accepted procedures and the approval 
of quality control applications. Its attention has been directed largely 
to the first of these. 

Applications of statistical quality control are now confined in large 
measure to the industrial leaders and to Army and Navy plants. 
Western Electric and Bell Laboratories, Johns Manville, Johnson and 
Johnson, Deere and Company, Minneapolis Honeywell Regulator, Timken 
Detroit Axle, Timken Bearing, Hoover Ball and Bearing, General 
Electric, Westinghouse, and Sentinel Radio, to mention a few, have 
developed more or less complete systems or plans for systems of 
statistical quality control throughout their plants. Many other com¬ 
panies appear to be engaged in extensive development and training 
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programs. In this group, Ford, International Harvester, Sheaffer 
Pen, and Jack and Heintz, might be included. Details of some of 
these reach publications of the American Society for Quality Control, 
or are discussed in the local section meetings.An index to the extent 
of use of quality control is given in a recent tabulation of speakers avail¬ 
able to local sections on the subject of quality control; the list included 
approximately 250 persons representing 100 industrial organizations.^^ 
This extends the list of those who participated in the wartime 10-day 
courses in quality control sponsored by the War Production Board. 
Nearly 2000 persons representing over 500 companies attended these 
courses and many of these have reported successful applications.^^ 
Nevertheless statistical quality control has not been applied in a great 
mass of American companies. In industrial cities few companies other 
than industrial leaders are utilizing statistical methods for controlling 
quality on a consistent basis. 

Statistical quality control has survived the transition from its war¬ 
time use and is becoming a fundamental factor in peacetime production. 
It is expected that the example of the industrial leaders will be followed 
within the next decade by a large share of American companies. This 
will come partly from the pressure to reduce costs by elimination of re¬ 
work and scrap, partly because the rapidly expanding use of acceptance 
sampling plans in setting standards will force the development of econo¬ 
mical quality controls on suppliers of materials. Also the leadership 
of the Army and Navy and other governmental agencies in applying 
quality controls and setting quality standards may have a powerful 
influence. The primary factor restricting the use of statistical quality 
control is lack of knowledge of its effective use. This is being overcome 
in part by the increasing number of courses in statistical quality control 
and in statistical theory offered in technical schools, the development 
of training courses in these methods by large companies on a company 
wide basis, and the enthusiastic membership of the American Society 
for Quality Control. Managements of large industrial companies have 

« Industrial Quality Control, Vol. 1 through 4, first published July 1944. 

The American Society for Quality Control was organized on February IC, 
1946, by accredited representatives from 17 local qualit 3 '' control societies. At the 
end of 1947, it was composed of 27 local Society Sections and included membership 
in excess of 2100. 

** Mimeographed list distributed to local sections of the ASQC. 

Holbrook Working and Edwin G. Olds, “Organizations Concerned with Statistical 
Quality Control,” Quality Control Report No. 2, June 1945; and Bibliography on 
Statistical Quality Control,” Quality Control Report No. 11, Sep. 1945. Issued by 
Quality Control Program, Carnegie Institute of Technology, Pittsburgh 13, Penn- 
sylvania. 
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enthusiastically responded to these new methods, but long and patient 
educational programs will be necessary to overcome the reluctance of 
older engineers, inspectors, master mechanics, and the foremen in the 
shops and to have them voluntarily embrace the fundamental changes 
in concepts that are necessary. What is important to the statistician^ 
is that the expansion of statistical quality control will introduce some 
features of industrial statistics to a new and large group of users, and 
will show the need for application of more precise statistical method 
to industrial and engineering problems. 


Resume 

Le controle statistique des fabrications en serio introduit dans Tin- 
dustrie americaine des notions qiii sont a la base des tests statistiques 
de signification, notamment celles comprenant les tests dc Thomogene¬ 
ity des moyennes et des variances des produits k cprtains intervalles 
pendant la production. Le eontrole statistique des fabrications en 
serie tend non seulement k Fusage de cartes de controle de machines, 
k des methodes de controle a la reception et de plans adequats de speci¬ 
fication, mais aussi de la synthese de ces elements. 

Les avantages de Temploi de ces techniques ont en partic un carac- 
t^re statistique en fournissant un plus grand degre de certitude pour 
des frais d’inspection donnes, ou en permettant de meilleures estimations 
des param^tres de la population par des methodes rationnelles d’cchan- 
tillonnage. En plus grande partie les avantages sont une consequence 
des changements fondamentaux, necessites par ces techniques, dans 
Tetablissement des plans, des systfemes dc production ct d'inspection. 
Ces methodes statistiques d’apprecier les produits et les precedes de 
production presupposent des definitions explicites de ces produits et 
precedes, ce qui a pour resultat une planification plus claire et la co¬ 
ordination des plans, de la production et de Tinspection. Le fait que 
les avantages proviennent dans une si large mesure des sources non- 
statistiques, fait la force du controle statistique et en meme temps, k un 
certain degre, la faiblesse de cette methode. Son application est dif¬ 
ficile sans Tappui complet de la direction principale de Tentreprise. 
Par consequent, sa divulgation est limitee k cause du defaut de con- 
naissance de ce nouvel instrument de controle de la part des directions 
et k cause de leur repugnance k apporter des modifications k des posi¬ 
tions precairement equilibrees dans une organisation en fonctionnement. 
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Et, 6tant donn6 que les avaiitages initiaux sont attribuables en grande 
partie k une vision plus claire des devoirs et responsabilit^s mutuels, 
il peut arriyer que les avantages possibles k long terme des applications 
syst^matiques du controle statistique soient negliges. Par consequent, 
beaucoup de directions dedarent et s’imaginent que le controle statis¬ 
tique est applique dans leurs etablissements, tandis qu’en realite il ne 
s’agit que d’une version faible et impuissante des cartes de controle 
ou de Tinspection par echantillonnage qui est appliquee sans les change- 
ments d’organisation qui sont necessaires k la realisation de resultats 
efFectifs. A present, Tapplication effective du controle statistique des 
fabrications en serie est, en general, limitee aux grandes entreprises in- 
dtistrielles, mais son influence est propagee par des cours d’entraine- 
ment dans des Universites et des Ecoles techniques, par les membres 
enthousiastes de American Society for Qtcality Controlf'* par des arti¬ 
cles instructifs dans des periodiques industriels et par Timpulsion don- 
n6e par le fait que les grandes entreprises et les services d’achat du 
gouvernement, pratiquent le controle k la reception. A la fin de la 
proehaine decade, la production industrielle non soumise au controle 
statistique sera peut-etre aussi rare que Texperimentation agricole sans 
planification statistique. 
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Discussion 

Mr. Molina recalled an early application of mathematical theory 
through which shop practices of the Western Electric factories were al¬ 
most completely revolutionized in 1905, when the design of automatic 
telephone systems was changed on the basis of probability and statistical 
theory. 

Mr. Womersley asked to what extent modified control limits 
have become part of standard practice in the United States as they have 
in Great Britain, where they were used particularly during the war. 

Mr. P a b s t replied that the use of modified control limits, based 
upon the British practice, have been widely used in the United States. 
Usually, however, they are used jointly with regular control limits. 



STANDARD SAMPLING-INSPECTION 
PROCEDURES 

by W. Allen Wallis 

University of Chicago (United States)^ 

1. Basic Concepts and Definitions 

1.1 Nature of Sampling Inspection 

Sampling inspection is a combination administrative technique and 
statistical technique. One of several possible actions is taken with 
respect to a set of distinguishable elements, choice of the action is based 
on measurements or classifications of one or more characteristics of 
individual elements, and although only a subset is measured or classified 
the action applies to the entire set. In these respects the problem of 
sampling inspection is essentially the fundamental problem of statistical 
inference [19].^ But sampling inspection differs radically from other 
statistical techniques because the character of the set of elements with 
regard to which action is required may be profoundly influenced by the 
sampling procedure; in fact, its success in this administrative function 
is one of the principal criteria for evaluating a sampling-inspection 
procedure. 

1.2 Terminology 

An element is commonly an individual unit of a mass-produced commo¬ 
dity and is called an item —for example, a washer, a washing-machine, 
or a wash-cloth. The set then consists of a collection of such items, often 
having in common some such feature as having been produced under 
similar conditions or having been received in a single shipment, and is 
commonly called an inspection-lot. An item may, however, be such 
a thing as a single performance of a machine, for example^ the quality 
delivered by a dispensing machine; the corresponding inspection-lot 
would be the aggregate of such quantities from repeated performances of 
the machine under stated conditions. Similarly, an item may be such 
a thing as the result of a clerical operation, for example, the product of a 
quantity and a price; the corresponding inspection-lot would be the 
aggregate of such products performed under stated conditions [1,14,30]. 

A subset that is measured or classified from an inspection-lot is called 

sample, and the measuring or classifying is called inspection. The 

' l^e author is indebted to Leonard J. Savage for a detailed and penetrating 
criticism of the manuscript that led to important improvements. 

* Numbers in square brackets indicate references listed in Section 6 of this paper. 
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characteristics with respect to which an item is inspected are called 
quality ^characteristics, and the measurements or classifications result¬ 
ing from the inspection of an item are collectively called the quality 
of the item or item-quality. 

Lot-quality is some 8p3cified function or group of functions of the 
qualities of the items in the inspection-lot. For example, it may be the 
arithmetic mean of one or more dimensions, the standard deviation of 
one or more dimensions, or the proportion meeting one or more criteria. 
8ample»quality, similarly, is some specified function or group of functions 
of the sample item-qualities. 

Sampling inspection usually chooses between only two actions; for 
example, delivery of a lot may be accepted or it may be refused. Accep¬ 
tance consists in taking one of the two actions, rejection in taking the 
other. It is conceived that knowledge of the lot-quality would determine 
which action should bo taken. 

In brief, sampling inspection is the process of accepting or rejecting 
material in lots on the basis of the quality of samples. 

2.3 Acceptance Inspection and Process Control 

The two most common uses of sampling inspection in industry are 
for process control and for acceptance inspection. The purpose of 
process control is to accept or reject a production process, that is, to decide 
whether items that will be produced in the future will be satisfactory. 
The purpose of acceptance inspection is to accept or reject existing mate- 
rial, that is,* to decide whether items that have been produced in the 
past are satisfactory. 

These two uses of sampling inspection have much in common, especial¬ 
ly from the viewpoint of statistical theory, but there is an essential 
difference; process control is concerned with time. Thus a control chart, 
the primary tool of process control, involves samples similar to those 
of acceptance inspection, but for a single process it involves a series of 
such samples spread through time; and acceptance or rejection of the 
process at any moment is based on the recent temporal behavior of sample- 
quality as well as on its level at the moment. In acceptance inspection 
the temporal relations of items within a lot are ignored. As a rei^ult, 
acceptance inspection is in essential respects a different statistical tool 
than process control. If an inspection-lot contains only the output of a 
process that has been found by control chart analysis to be “in statis¬ 
tical contror’[27i, acceptance sampling serves no purpose (except perhaps 
as a sort, of check, through more data, on the control sampling) [16]. 
On the other hiand, acceptance inspection may be appropriate when 
a process is not in control or where process control is inappropriate 
or impossible^for example, when it is desirable or necessary to have 
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‘^arms-length’’ inspection,, that is,, inspection entirely independent of 
the production process. It is often possible to improve the effective-, 
ness of an acceptance inspection program by treating the sample-quali¬ 
ties of successive inspection-lots on a basis somewhat similar to process 
control. 

The term ‘"sampling inspection,** like the term “quality control,” 
is properly applicable both to acceptance inspection and to process 
control. In common usage, however, “sampling inspection” is apt to 
refer only to lot-by-lot acceptance inspection, and “quality control** 
only to process control. Perhaps a justihcation of this usage is that 
“inspection*^ suggests evaluation of existing results of past operations, 
while “control** suggests regulation of the potential results of future 
operations. At any rate, in this paper “sampling inspection” is ordinarily 
limited to “acceptance inspection*’ and does not include “process 
control.*^ 

Continuous process inspection has elements of both process control 
and acceptance inspection [2, 30]. It is particularly useful where lot- 
by-lot acceptance inspection is desired but accumulating the material 
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in inspection lots is impractical; such is the case with highly integrated, 
continuous processes, where raw material may remain in continuous 
motion through fabrication, packaging, and conveyor-belt loading into 
freight cars. Continuous process inspection will not be included, 
however, in the discussion of sampling inspection in this paper. 

1.4 Sampling Inspection and Significance Tests 
From the viewpoint of statistical theory, sampling inspection is a test 
of. significance, that is, a test of the conformance of a set of data to a 
statistical hypothesis. The correspondence of terms is shown in the 
accompanying tabulation. The concepts denoted by these nine pairs 
of terms are fundamental to the current theory of testing statistical 
hypothesis. They were developed independently along closely parallel 
lines during approximately the decade 1925 to 1935, those of sampling 
inspection in the United States (almost entirely by H. F. Dodge, 
H. G. R o m i g, W. A. S h e w h a r t, and their colleagues at the Bell 
Telephone Laboratories [3, 26]) and those of theoretical statistics in Great 
Britain (almost entirely by R. A. F‘i s h e r, J. N e y m a n, and E. S. 
P^e arson, in large part at the. University of London [7,20]). Only 
in the past five to ten years, largely as a consequence of the war, have 
these two independent parallel developments tended to merge and to 
cross-fertilize. 


2. Lot-Quality and Sample-Quality 

2.1 LoUQuality 

In an overwhelming majority of cases where sampling inspection 
is used, lot-quality is defined in terms of the proportion of defective 
items in the inspection-lot, an item being defined as defective if any 
one of a list of attributes {defects) is present. But sometimes lot-quality 
is measured by the mekn or variability of a quality-characteristic, for 
example, the average number of defects per item, the mean value of 
a continuously variable (‘‘measurable’’) characteristic, or the standard 
deviation of a measurable characteristic. 

Each method of measuring lot-quality permits a variety of useful 
methods of measuring sample-quality, provided certain information is 
known about the distribution of item-quality within inspection-lots. If 
the distribution of items by number of defects is Poissonian, for 
example, measurement of sample-quality in terms either of percent 
defective or of defects per item will permit inferences both about per¬ 
cent defective and about defects per item in the inspection-lot. Thus 
the method of measuring sample-quality is not in general fixed by the 
method of measuring lot-quality, but can be determined by economic 
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considerations, in particular by comparing the statistical efficiency 
with the cost of each measure of sample-quality. 

2.2 Sample-QyMity 

2.2.1 Binomial Distribution. Sample-quality is nearly always 
measured by proportion defective, each sainple item being classified 
as defective (one or more defects) or nondefective. The binomial dis- 
tribution then represents satisfactorily the sampling distribution of 
sample proportion defective, unless either the number of defectives or 
the number of nondefectives corresponding with the acceptance cri¬ 
terion constitutes a significant fraction of the number of defectives or 
nondefectives, respectively, in the lot, in which case the hypergeometric 
distribution must be used. 

The binomial distribution has these advantages: 

(i) It affords maximum operating simplicity and economy. Each 
item need only be classified into one of two categories; simple gauges 
and relatively little skill usually suffice, and there is a minimum of record 
keeping and computing. 

(ii) It involves a minimum of mathematical assumptions. The 
binomial distribution (or the hypergeometric distribution under the 
conditions mentioned above) is certain to describe the distribution of 
sample-quality if (a) each item is simply classified defective or nonde¬ 
fective and (b) the sampling is effectively random. 

(iii) Most of the computations necessary for devising and evaluating 
sampling plans are readily available, through tables of the binomial 
and incomplete-beta functions [23,31,32] through the normal [6] and 
Poisson [15, 41] approximations, which in turn are well tabulated, or 
graphically through binomial probability paper [18]. 

The principal disadvantage of the binomial distribution is statistical 
inefficiency; it requires larger samples than are needed when enough 
is known of the distribution to justify more detailed measurement of 
each item. For example, if a quality characteristic is normally distri¬ 
buted and values above a certain limit are defects, control of the percent 
defective through an appropriate function of the sample mean and sample 
standard deviation will not require as large samples as the same control 
through the sample percent defective [9, 29]. The larger samples required 
under the binomial, however, ordinarily cost less than would smaller 
samples involving more detailed measurement and more expensive cal¬ 
culation, chiefly because the cost per item is low with attributes but 
partly because with variables it is necessary to make careful statistical 
studies of the validity of the normality assumption (in fact, the greater 
the gain from using variables the stronger, generally speaking, is the 
dependence upon the normality assumption). 
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,2.2.2 Poisson Distribution. If each item can have a large number 
of defects, and if the probability of its having any given defect is small 
and independent of whether it has other defects, then the Poissoii dis¬ 
tribution gives a satisfactory representation of the sampling distribution 
of number of defects [24]. Acceptance inspection is often based on 
number of defects for items of which many have several defects, for 
example, motor trucks, or telephone switchboards.. If the mean num¬ 
ber of defects per item is more than about 0.2, use of the Poisson dis¬ 
tribution permits appreciably smaller samples than would be required 
for the same reliability with the binomial distribution [30]. On the 
other hand, special studies are required to determine whether the dis¬ 
tribution of defects is in fact Poissonian, so inspection on this basis is not 
so readily standardized and routinized as inspection on a binomial, basis. 

2.2.S Normal and Student Distributions. When lot-quality is mea¬ 
sured by the mean of a characteristic, the sample mean of this charac¬ 
teristic is commonly used as the measure of sample-quality. The nor¬ 
mal distribution gives a satisfactory representation of the sampling 
distribution of sample means, provided the lot standard deviation is 
known [25]. Sometimes the lot standard deviation is stable, and can 
therefore be determined from past data. More often, the standard 
deviation must be estimated from the same sample that is being used 
to test the mean, in which case the Student distribution is appropriate 
[8, 21]. In general, these distributions are not seriously affected by 
moderate departures from normality in the distribution of items, so 
sampling inspection is less dependent on continual verification of mathe¬ 
matical assumptions when done on this basis than when done on any 
other basis except the binomial. 

2.2.4 Chi-sqmre and Range Distributions, It is not often that lot- 
quality is measured by the standard deviation. When it is, sample- 
quality is usually measured either by the sample standard deviation or 
by the sample range. The chi-square distribution represents the sam¬ 
pling distribution of the sample standard deviation (more precisely, 
of a simple function of the sample standard deviation), if the items are 
normally distributed [8, 29,40]. For very small samples the range may 
be used as the sample measure of variability; its distribution is also 
known, again assuming normality [12, 22]. Acceptance inspection, 
unlike process control, ordinarily involves samples too large for the 
range to be efficient, despite the simplicity of measuring it. The average 
range in subsamples is a device for reducing this inefficiency [11]; 
another device is an appropriately chosen int^r-percentile range, for 
example, the diflF^rence between the first and ninth deciles [17]. 

2.2.5 Noncentral-t Distribution. If lot-quality is measured by the 
proportion of items for which a measurable quality characteristic 
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exceeds (alternatively, falls short of) a stated limit, and if item-quality 
is normally distributed, then sample-quality may be measured by the 
difference ‘between the limit and the sample mean, divided by the 
sample standard deviation. This measure of sample-quality will be 
distributed according to the noncentral-^ distribution [9, 13, 29]. Sub¬ 
stantial reductions in sample size can be obtained by basing inspection 
on this distribution instead of on the binomial distribution, but the 
greater inspection cost per item when measurements are required, the 
greater volume and complexity of records and computations, and the 
necessity of competent statistical checks on the normality assumption, 
all combine to limit its usefulness to products for which inspection costs 
per item are especially high even with attributes, as when the inspec¬ 
tion involves destruction of expensive items. 

3. Types op Sampling 

3.1 Randomness 

Each of the four types of sampling—single, double, multiple, and 
sequential—commonly used in sampling inspection is based on random¬ 
ness. That is, each individual sample must be drawn by an effectively 
random process. Randomness is an attribute of a sampling process, 
not of an individual sample; a sampling process need not be strictly 
random but only effectively random; and the samples consist of sets 
of measurements or classifications, not of the items to which the mea¬ 
surements or classifications pertain. 

A sampling process is strictly random if the probability that any item- 
quality will be included in the sample is (i) equal to its relative frequency 
in the inspection-lot, and (ii) independent of the other item-qualities 
in the sample, except through their number. One way to assure strict 
randomness is to see that each item in the inspection-lot has the same 
chance of being selected for inspection, and that this chance is not affected 
by which other items are selected; this method assures strict randomness 
with respect to every characteristic of the items. ' 

Even if a sampling process is not strictly random, it may be effectively 
random, that is, it may be that the probability of drawing a sample with 
any given value of a specified measure of sample-quality is the same 
as it would be under strictly random sampling. For example, if an 
inspection-lot is presented with the items arranged in a number of piles, 
it may be that taking the top item from each pile would be an effec¬ 
tively random sampling procedure with respect to, say, mean tensile 
strength. Whether a particular sampling process is effectively random 
is itself a subject requiring statistical investigation, unless strict 
randomnqss has been obtained by assuring each item the same probabi¬ 
lity of representation in the sample. 
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Most discussions of randomness simply say that the probability of 
inclusion must be the same for all items in the population. Since this 
condition is often impractical it is perhaps worth restating the point 
that, while sufficient, it is not necessary: Given the item-qualities of 
. an inspection-lot, consider a hypothetical population each of whose ele- 
mjents is a combination of N of the item-qualities, each possible combi¬ 
nation of N. item-qualities being equally frequent in this population. 
Then consider each combination of N to be replaced by a single number, 
representing whatever measure of sample-quality is of interest. Thus, 
we have generated a population of sample-qualities; the relative fre¬ 
quency of any sample-quality in this population shows what the pro¬ 
bability of that sample quality would be with strictly random sampling 
from the inspection-lot. Now a sampling process may be termed effec¬ 
tively random if the probability that it will yield a sample with any 
specified sample-quality is equal to the relative frequency of this sample- 
quality in the hypothetical population of sample-qualities. Expressed 
differently, a sampling process is effectively random if the population 
of sample-qualities that would be generated by infinitely many repe¬ 
titions of the sampling process is identical with the population of sample- 
qualities derived from our hypothetical population of combinations of 
N items from the inspection-lot. Thus, a sampling process is effectively 
random if it produces the sample-qualities in the correct proportions, 
regardless of the internal compositions of the samples that accomplish 
this. 

3,2 Single and Sequential Sampling 

Two essentially different types of sampling are widely used in samp¬ 
ling inspection. In one type, single sampling, a fixed number of items 
to be inspected is determined in advance and all of them are inspected; 
in the other type, sequential sampling, the number of items is a variable, 
and depends upon the sequence of item-qualities found in sampling. 
Sequential sampling may take various forms; in particular, there may 
be an upper limit to the number of items that will be inspected or this 
may be open, and the successive samples may contain only one item 
each or they may contain several items. When not more than two sam¬ 
ples are to be inspected, we have double sampling (historically the first 
systematic type of sequential sampling), and when not more than some 
fixed number (greater than two) of samples are to be inspected we have 
multiple sampling; the individual samples in both double and multiple 
sampling almost invariably contain several items rather than only one. 
Curtailed sampling refers to discontinuing inspection within one of the 
samples, instead of inspecting an integral number of samples; inspec¬ 
tion may be curtailed if the outcome of the sampling is determined before 
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the entire sample has been inspected, as for example, when the number 
of defectives reaches the rejection number. Curtailed single sampling, 
if the preceding distinction between single and sequential sampling is 
adhered to, is sequential rather than single sampling, since the amount 
of inspection is a variable depending upon the progress of the sampling. 
The term “sequential sampling” is often used in a special sense to mean 
either (i) a particular sequential form called the “sequential probability 
ratio” form in which the acceptance and rejection criteria are essen¬ 
tially parallel linear functions of the sample size [30, 38], or (ii) multiple 
sampling, usually with a‘fixed maximum number of samples, in which 
the acceptance and rejection criteria are derived, at least to a first ap¬ 
proximation, from the sequential probability ratio [28, 34, 35, 36, 37]. 

Single sampling can minimize (i) the maximum number of items ins¬ 
pected per inspection-lot, (ii) the number of separate samples inspected, 
and (iii) the variability of the number of items inspected per inspection 
lot. Sequential sampling can minimize (iv) the average number of 
items inspected per inspection-lot. 

4. Statistical Properties of Samm-ino Plans 
4,1 Operating Characteristics 

A sampling plan is essentially a rule for accepting or rejecting 
inspection-lots. In the preceding sections we have considered the main 
features of such a rule, in particular selection of samples, computation 
of the sample-quality, and acceptance and rejection criteria. What¬ 
ever the details of the rule, and however naive or sophisticated the mo¬ 
tivation for them, a most important aspect of their statistical conse¬ 
quences is described by the operating-characteristic function, called 
the OG function or the OC curve. 

The OC function shows the probability that the sampling plan will 
result in acceptance: the probability, in other words, that random sam¬ 
pling will result in a sample-quality meeting the acceptance criterion. 
Obviously this probability depends upon the lot-quality; with any use¬ 
ful sampling plan it is large for very good lots and small for very poor 
lots. A graph showing the probability that an inspection-lot will be 
accepted under a given sampling plan as a function of the lot-quality 
is the OG curve of that sampling plan. 

The OG function shows a buyer or other receiver of the goods what 
protection is afforded by the sampling plan, that is, what the probabi¬ 
lity is that if a poor lot is submitted it will be accepted. It shows a seller 
or other supplier of the goods what is required of him by the sampling 
plan, that is, what his quality must be in order to achieve a given pro¬ 
bability of having his material accepted. Given a sampling plan, the 
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seller will strike a balance between two factors: (i) incurring the costs 
of producing high quality material, but thereby avoiding the costs of 
having numerous inspection-lots rejected; (ii) incurring the costs of 
numerous rejections but avoiding the costs of high quality production. 
The buyer, in selecting a sampling plan, will also strike a balance between 
two factors: (1) incurring substantial costs for unsatisfactory material 
that is passed by the sampling plan, but avoiding a high purchase 
price; (ii) incurring a high purchase price, but avoiding high costs from 
accepting unsatisfactory material. This conscious reaction of the sup¬ 
plier to the OC function, and the fact that the receiver is influenced in 
selecting an OG function by his estimate of the supplier’s reaction, is 
a vital feature of sampling inspection, and makes it much more than a 
useful statistical technique: it is an effective administrative technique 
for coordinating two independent parties to an undertaking without the 
necessity of an authority empowered to issue commands to both. 

It should be emphasized that the OC function does not show the pro¬ 
bability that an accepted lot will have a certain quality. That proba¬ 
bility would be proportional to the product of two probabilities, 

(i) the probability that a lot of the specified quality will be offered, and 

(ii) the conditional probability that if such a lot is offered it will be accep¬ 
ted. Only the second of these is subject to control by an acceptance 
inspection plan> and it alone is shown by the OC function. Any infor¬ 
mation about the first probability will profoundly influence a supplier’s 
or a receiver’s reaction to the operating characteristics of a sampling 
plan; indeed, the buyer’s and seller’s compromises between alternative 
costs, referred to in the preceding paragraph, cannot be made rationally 
without assumptions about the probabilities, with various sampling 
plans in effect, that various lot-qualities will be submitted. 

While a sampling plan cannot control the outgoing quality of each 
individual lot, an ingenious modification often makes it possible to limit 
the worst possible average outgoing quality. This modification consists 
of a requirement that rejected lots be replaced by perfect lots, by in¬ 
specting every item in each rejected lot. Then outgoing quality will be 
perfect if incoming material is either all good or all bad, and there will 
be some intermediate quality which if invariably submitted, would 
minimize the average outgoing quality; the minimum that would be 
attained is called the avercuge outgoing quality limit or AOQL [5]. Such 
a modification is not possible if inspection is destructive or if virtually 
perfect accuracy in inspection is not feasible; and, as remarked, the 
limit applies only to the average quality of a large number of lots, not 
to individual lots. Like continuous process inspection, inspection on 
an AOQL basis has elements of both acceptance inspection and process 
control. 
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4,2 Amount of Inspection 

The cost of operating a sampling plan depends largely on the amount 
of inspection it requires. With sequential sampling the amount of ins¬ 
pection varies with the lot-quality of the submitted material, and for 
a given lot-quality it varies by chance. Thus, for any given lot-quality 
there is an expected or average amount of inspection required to reach 
a decision, and this average amount of inspection (usually called the 
average sample number, or A8N) is a function of lot-quality whose 
graph is called the .4 iSiV curve [28, 30]. For single sampling, the A8N 
function is, of course, constant, that is, independent of lot-quality. 

The A8N function shows an important cost characteristic of a sam¬ 
pling plan. Other characteristics of sampling plans that affect their 
operating costs include [28, 29]: 

(i) the maximum number of samples that may have to be inspected; 

(ii) variability in the number of samples; 

(iii) the maximum number of items that may have to be inspected; 

(iv) variability in the number of items; 

(v) the cost of the individual measurements; 

(vi) the amount and complexity of record keeping and computing; 

(vii) the cost of any statistical studies necessary to verify assump¬ 
tions about the distribution of sample-quality, the effective 
randomness of sampling procedures, the validity of tests of 
increased severity, etc.; 

(viii) the inspection-lot size, since for a given sample size the amount 
of inspection per unit produced is inversely proportional to the 
inspection-lot size. 

An offset to the cost of a sampling inspection plan is the value of any 
byproduct information it yields—as, for example, if information on 
number of defects per unit, or on kind of defects is of value, even though 
acceptance or rejection could be based on sample percent defective alone. 

When the A8N function and other pertinent data indicate that the 
operating costs of a sampling plan are too high, one or more of the fol¬ 
lowing adjustments may be possible: 

(i) A similar plan, but with less protection to buyer or seller may 
be adopted. 

(ii) A plan may be adopted which uses more detailed quality in¬ 
formation for each item, as when measurements and the non- 
central-i distribution are substituted for attributes and the • 
binomial distribution. 

(iii) A change may be made in the quality-characteristic being ins¬ 
pected, substituting a characteristic which is functionally 
related to, or at least highly correlated with, the characteristic 
of primary concern. The most common substitution is a test 
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of increased severity, since less inspection is required when the 
acceptable and rejectable lot-qualities are, for example, 5 
and 15 percent defective than when they are 0.05 and 0.15 
percent defective. 

(iv) The plan may be kept unchanged but the inspection-lot size 
increased. The OG function, except when the sample is large 
relative to the inspection lot, depends almost entirely on the 
absolute size of the sample. Increasing the inspection-lot 
size therefore leaves the protection unchanged but reduces 
the amount of inspection per item produced. 


6. Standard Procedures 

5,1 General Principles 

The discussion so far has dealt with sampling plans—their nature, 
their consequences, and their costs—and has outlined the chief consi¬ 
derations that would be taken into account by a statistician carefully 
designing a sampling plan to suit the many facets of a particular situa¬ 
tion. Such careful designing of sampling plans is often impossible be¬ 
cause of scarcity of sampling inspection experts, and even when possible 
it would often be ijneconomic. 

A standard sampling inspection procedure is a procedure for selecting 
and operating sampling plans. With a standard procedure, many ques¬ 
tions are settled arbitrarily which would be decided by an expert only 
after careful study; for other questions, the range of choice is narrowed 
to relatively few alternatives, with detailed prescriptions for choosing 
among these; and some questions are analyzed into component parts, 
each to be decided separately by someone whose regular work gives him 
the competence. As with mass production, the object of standardi¬ 
zation is to increase output and lower cost; as with mass production, 
some loss of quality is incurred through standardization, but usually 
not nearly enough (if the standardizing is sound) to offset the gains in 
quantity and cost. In other words, a standard sampling inspection 
procedure makes it possible to introduce useful, but usually not ideal, 
sampling inspection plans rapidly and economically. 

The foundation of a standard sampling inspection procedure is a set 
of sampling plans—sample sizes and acceptance and rejection criteria— 
together which such pertinent information about each plan as its accep¬ 
table quality level, rejectable quality level (often called lot tolerance 
percent defective or LTPD\ operating-characteristic function, average 
outgoing quality limit, and average sample number function. Such a set 
should include a plan sufficiently close to the ideal one for any speci¬ 
fic circumstances, but should contain as few different plans as yrill meet 
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this requirement reasonably satisfactorily. Numerous questions must 
be decided in order to find in this set of sampling plans the one most 
appropriate to a particular, problem. A standard procedure lists these 
questions, allocates the responsibility for answering them, and provides 
guidance for answering each question. 

An important principle in constructing a standard procedure is that 
the component questions into which the selection of a plan is resolved 
should be as nearly as possible mutually orthogonal: the effect of a 
certain answer should be the same whatever answers are given to other 
questions. Orthogonality is necessary for the administrative workabi¬ 
lity of the procedure. Suppose, for example, that the probability of 
accepting material at the acceptable quality level were to depend on 
whether single or sequential sampling is used. Then the person res¬ 
ponsible for determining the acceptable quality level could not properly 
do so unless he knew what type of sampling would be chosen. Choice 
of the acceptable quality level is appropriately made by a technical 
person familiar with the production and uses of the commodity, while 
choice of the type of sampling is appropriately made by an inspection 
person. It would be necessary for these two persons to try to strike 
a balance between noncomparable factors. With a properly designed 
standard procedure, however, the probability of accepting an inspec¬ 
tion-lot of acceptable quality will be substantially independent of the 
type of sampling. 

A standard sampling inspection procedure can be divided into four 
major steps [28,36]: 

(i) Establishment of standards. 

(ii) Installation of a sampling plan. 

(iii) Operation of the sampling plan. 

(iv) Review of results. 

The first and fourth steps relate primarily to quality requirements of the 
product while the second and third relate primarily to the administration 
of sampling inspection. 

5,2 Special topics 

5,2,1 Sample Size, The operating-characteristic function of a sam¬ 
pling plan, which fully describes the protection afforded by the plan, 
may be characterized by two features, its steepness and its location. 
The steepness indicates the degree of discrimination attained: if the 
OC function is steep, there will be only a small gap between qualities 
that are nearly always accepted and qualities that are nearly always 
rejected; if it is shallow this gap will be large. The location indicates 
which qualities are generally accepted and which are generally rejected. 
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Since the steepness of the OC function is determined almost entirely 
by the sample size, and scarcely at all by the lot size (except under con¬ 
ditions noted previously), it might seem that the same sample size would 
be used for all lot sizes, this sample size depending on the sharpness of 
discrimination required. How much discrimination it is wise to buy 
depends, however, on the cost; the point at which further discrimination 
would not be worth its cost comes sooner when the cost is high than 
when the cost is low. The cost that is relevant here is the cost of ins¬ 
pection per item produced. This will be less if inspection-lots are large 
than if they are small. Thus, more inspection in absolute amount, but 
presumably less in relative amount, should be given to large lots than 
to small lots, other things beipg equal [28]. The proper increase of sam¬ 
ple size with lot size is one of the most difficult problems in designing 
special sampling plans; in current standard procedures it is simply 
determined arbitrarily, with no other guide than that there should be 
some increase but not as much, proportionately, as in the lot size [28, 
33, 34, 35, 36]. 

5,2,2 Acceptable Quality Level. The fact that the sample size, and 
hence the steepness of the OG function, increases with lot size means 
that complete uniformity of treatment is not possible for all classes of 
suppliers. For example, if all are given the same probability of accep¬ 
tance for good material, suppliers submitting small inspection-lots will 
have a higher probability of acceptance for poor material than will sup¬ 
pliers submitting large inspection-lots. On the other hand, if the receiver 
insists on uniform protection against the acceptance of poor material, 
suppliers submitting large inspection-lots will have a higher probability 
of acceptance for good material than will suppliers submitting small 
inspection-lots. 

It is to the receiver’s interest that inspection-lots be as large as prac¬ 
ticable, since the larger they are the steeper the OC function and the 
less the inspection costs. The supplier’s interest is in small inspec¬ 
tion-lots if all inspection-lots have the same probability of acceptance 
for good material, and in large inspection-lots if all inspection-lots have 
the same probability of acceptance for poor material. If all suppliers 
were essentially similar in their capacity for submitting large inspection- 
lots, this would point toward holding the consumer’s risk constant. In 
fact, suppliers generally are not similar in'this regard, and holding the 
consumer’s risk constant would discriminate against small suppliers 
and in favor of large suppliers. Current standard procedures, there¬ 
fore, generally hold the producer’s risk essentially constant; that is they 
treat alike (give practically the same probability of acceptance to) all 
inspection-lots that are of acceptable quality [28, 33, 34, 35, 36]. 
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It is thus convenient in standard procedures to measure the location 
of an OG function by, and to classify sampling plans according to, some 
lot-quality which will be accepted nearly always. “Nearly always” 
requires exact definition; the usual definition in this context is “approxi- 
mately ninety-five percent of the time.” Thus sampling plans are 
characterized and classified by acceptable quality level (AQL) defined 
as that lot-quality for which the probability of acceptance is 0.95. 

5.2.3 Type of Sampling. When different types of sampling are included 
in a standard procedure, for example, single, double, and multiple sam¬ 
pling, their OC functions are matched as nearly as possible. That is, each 
available OC function can be attained by single, by double, or by mul¬ 
tiple sampling. The decision as to type of sampling can be made by 
inspection personnel and changed by them at will, since it will affect 
only the costs of operating the j3lan but not its consequences. 

5.2.4 Review of Past Results. Standard procedures usually provide 
for analyzing the results of a series of inspection-lots on something 
resembling a process control basis. If evidence accumulates that bad 
lots are not likely to be submitted, as when the process appears to be, in 
some sense, “in control”, the protection against such lots can be reduced 
(reduced inspection)', that is, the OC function can be fiattened, keeping 
the AQL fixed, which reduces the amount of inspection. Similarly, 
if evidence accumulates that bad lots are very likely to be submitted, 
the protection against accepting them can be tightened (tightened inspect 
tion) ; tightening may be accomplished either by increasing the amount 
of inspection with the AQL fixed, or by decreasing the AQL with the 
amount or inspection fixed, the latter being perhaps justifiable on the 
ground that the receiver should not incur extra inspection costs because 
of the supplier’s shortcomings [28, 36]. 

5.3 Prospective Developments 

Development of standard sampling inspection procedures in the 
immediate future is likely to proceed along four lines. 

(i) Revision in detail. Most existing standard procedures have been 
prepared hurriedly. Approximations have been used in computing 0(7 
functions. Some sets of supposedly matching plans may not actually 
match as closely as possible. Plans may have been matched too closely 
for different types of sampling at the expense of consistency among 
acceptable quality levels and among lot sizes. No existing standard 
procedure supplies the ASN curves for its sampling plans. Criteria for 
shifting to reduced or tightened inspection, or for returning to normal 
inspection, are probably not ideal. In general, there are many oppor¬ 
tunities for improving existing standard procedures. 

44 
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(ii) Integration with process control. Developments in acceptance 
inspection and in process control have for the most part, proceeded 
more or less independently. Especially where acceptance inspection is 
used by a manufacturer within his own plant or among his own plants, 
there appears to be need of more effective integration of the two than 
has so far been worked out. 

(iii) Extension of coverage. Existing standard procedures utilize 
only the binomial distribution, treat different quality-characteristics 
essentially independently, and require the accumulation at one time 
of the full inspection-lot. Techniques for removing all these and other 
limitations are now available and in use in special sampling plans, but 
have not been incorporated into standard procedures. With an in¬ 
crease in the number and quality of statisticians available, it may be 
possible to utilize routinized and standardized procedures for conti¬ 
nuous process inspection, for the use of variables to control proportion 
defective, and for multivariate measurement of sample-quality [2, 9, 
29, 30, 39]. 

(iv) Development of the economic theory of sampling inspection. 

Even where a sampling inspection plan is designed for a particular situa¬ 
tion, the fundamental problems of the economically best amount of 
inspection and location of the AQL cannot bo solved with existing theo¬ 
ry. Until more progress is made on these basic economic issues, stand¬ 
ard procedures will remain fundamentally arbitrary in their most im¬ 
portant aspects. The progress to bo made in standard sampling ins¬ 
pection procedures from a solution of these economic issues probably 
dwarfs the combined potentialities of all three of the other lines of de¬ 
velopment [28]. 
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R48um4 

L’inspection par echantillonnage est la methode d’accepter ou de 
rejeter des lots de materiel suivant la qualite d’echantillons. Un plan 
d’inspection par echantillonnage consiste a specifier des regies pour: 
I) former un lot d’inspection, II) s61ectionner un ou plusieurs echantillons 
du lot, III) determiner la qualite de Fechantillon ou des echantillons, 
et IV) accepter ou rejeter le lot dans son ensemble suivant la qualite 
de Techantillon (des echantillons). Une procedure standard d’inspection 
par echantillonnage est un ensemble de directives pour la selection et 
Toperation de plans d’inspection par echantillonnage. 

Dans la plupart des plans d’inspection par echantillonnage, la qualite 
du lot est mesuree par la proportion dc pieces ne repondant pas aux carac- 
teristique^ imposees et la qualite de Techantillon est determinec en clas- 
sifiant les pieces de rechantillon comme acceptables ou defectueuses, 
sans mesurer le degre d’acceptabilite ou de defectuosite. Cependant, 
parfois des mesures plus compliquees de la qualite des lots ou des echan¬ 
tillons sont utilisees. 

L’echantillonnange simple consiste en Texamen d’un nombre fixe de 
pieces pour chaque lot; la Methode de score (“sequential sampling”)- 
consiste en Texamen d’un nombre de pieces dependant des resultats suc- 
cessifs obtenus en cours de travail. La methode de score comprend 
l’6chantillonnage simple reduit(“curtailed simple sampling”), rechantil- 
lonnage double, Techantillonnage multiple, et rechantillonnage pi^ce 
par pifece proprement dit. L’echantillonnage simple minimise le nombre 
maximum de pifeces examinees d’un lot quelconque, le nombre d’echan- 
tillons ipdividuels d’un lot quelconque, et la varabilite parmi les lots 
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du nombre de pieces examinees; la m^thode de score minimise le nom- 
bre moyen de pieces examinees par lot. 

Les consequences statistiques les plus importantes d’un plan d’6chan- 
tillonnage sont exprim^es par sa courbe caract^ristique (ou courbe OC). 
Elle montre, en fonction de la quality du lot, la probability que Pychan- 
tillonnage au hasard rysultera en un ychantillon (ou serie d’ychantillons) 
rypendant au crityre d’acceptation. La courbe OC mesure le degre 
de protection du destinataire, gi4ce au plan d’echantillonnage, centre 
1 acceptation de material dyfectueux qui lui a ete offert. Elle montre 
au producteur les exigences imposyes k la quality et, pour cette raison, 
influence la qualite produite. De cette maniyre, Finspection par ychan- 
tillonnage a une importante fonction administrative, en coordonnant les 
roles des diffyrents intyressys; e’est principalement cette fonction ad¬ 
ministrative qui fait distinguer sous des rapports fondamentaiix, Tirs- 
pection par echantillonnage d’autres tests de signification. 

Une procydure standard pour la syiection et Tope ration de plans 
d’ychantillonnage dycide, sur la base de Pexperience genyrale, beaucoup 
de questions qui pourraient etre dycidees par un expert seulement aprfes 
examen soigneux de la situation particuliyre. Pour d^autres questions, 
I’intervalle des choix possibles est ryduit y. un nombre relativement 
restreint d’alternatives, avec des instructions detaillees pour faire le 
choix parmi elles. Et certaines questions sont divisees en parties com- 
posantes oh, pour chaque composante, la decision peut etre prise par 
un expert en la matihre. Bien que la standardisation de mythodes d*in- 
spection par ychantillonnage peut avoir pour rysultat Temploi de plans 
qui ne sont pas aussi bons que ceux qui pourraient etre etablis par des 
experts aprhs examen approfondi de situations particulieres, la standar¬ 
disation rend possible d’introduire des plans utiles d’inspoction par 
ychantillonnage d’une manihre rapide et yconomique. 

La base d’une procedure standard d’inspection par ychantillonnage 
est une collection systymatique de plans d’echantillonnage, en meme 
temps que des renseignements relatifs k chaque plan. Une procydure 
standard ynumhre les questions k rypondre pour faire de la collection 
la syiection du plan le plus adyquat au probiyme envisage; et elle assigne 
les responsabilitys et sert de guide pour la reponse des questions. Les 
questions doivent etre telles que I’effet d’une certaine ryponse est le meme, 
quelles que soient les ryponses donnyes aux autres questions; ceci est 
nycessaire pour une division effective de la responsability administrative. 
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In this paper, the word Specification denotes a document containing 
(1) a more or less exact description of those characteristics which render 
a given manufactured item or a given basic material acceptable, and (2), 
instructions as to the methods to be used to obtain evidence that the item 
or material really has the characteristics of acceptability. The specifi¬ 
cation is made available to the producer or supplier of the item or mate¬ 
rial when he is invited to bid on a contract or order, and if his bid is accep¬ 
ted, the specification is made a part of the contract. 

Such specifications arc now used extensively in large-scale procurement 
in the ’United States, and particularly in Government procurement. 
Three especially noteworthy series of specifications are the basic materal 
specifications promulgated by the American Society for Testing Materi¬ 
als, the miscellaneous purchase specifioations issued by the Federal Speci¬ 
fication Board (known as Federal Specifications and catalogued in the 
Federal Standard Stock Catalogue), and the somewhat more specialized 
and exacting series of purchase specifications of the Navy Department. 

The fundamental distinction between direct statements as to the 
required properties of the item or material, and statements concerning 
the amount and nature of evidence deemed necessary to establish that 
required properties are present, is now widely recognized by writers of 
specifications, and generally the two types of statement are carefully 
separated in the editorial format. We shall call statements of the first 
type, design requirements, and statements of the second type, ctccepUince 
requirements. Acceptance requirements fall into two further classes: 

(a) Sampling requirements (including as a special case the requirement 
of 100 percent inspection). These comprise the administrative procedure 
whereby the material is accepted or rejected. 

(b) Methods of test. These consist of the detailed procedures for 
obtaining the data on which the administrative procedure is based. 

In most series of specifications, it is customary to include design re¬ 
quirements and acceptance requirements in the same leaflet. It should 
be mentioned in passing, however, that there is a school of thought in 


351 



3S2 IN^^B&NATIO^^At STATISTICAL CONFBttB!fc^CES: I S 1 

the United States which holds that the two types of requirement should 
always be kept separate, to the end that the acceptance requirements 
corresponding to a given set of design requirements can readily be tailored 
to fit local circumstances and the changing economic picture. 

In establishing design requirements for specifications, the central 
statistical technique is that of estimation in the Fisherian sense. 
Sampling requirements rest most frequently on tests of parametric statis¬ 
tical hypotheses, although considerable use has been made of the theory 
of a certain stochastic process identified in quality control work with the 
concept of the average outgoing quality. Various modern statistical 
techniques play significant roles in the development of methods of test; 
perhaps the most pressing practical problem here is the prediction of 
service performance from laboratory tests, so regression analysis with 
the associated predictive and inferential techniques is of central impor¬ 
tance. The statistical aspects of the development of methods of test 
will not be discussed further in this paper. The establishment of design 
requirements by statistical methods and the setting up of statistically 
based sampling plans in specifications will now be discussed in some 
detail. 

In establishing quantitative design requirements, the main engineering 
problem is to set up realistic tolerance limits. This leads to a statistical 
problem which, in its simplest formulation, consists of that of estimat¬ 
ing one or two of the extreme percentiles of a frequency distribution 
from sample data representing the^distribution. An alternative formu¬ 
lation, which may or may not lead to the same estimators, depending 
upon the mathematical interpretation given to the verb “to estimate,’* 
consists in stating that the problem is, e.gr., to estimate the central 
99% range of the parent frequency distribution. This type of estima¬ 
tion problem has come to be known in the mathematical literature as 
the problem of tolerance limits. Various solutions have been develop¬ 
ed; a typical approach consists in setting up an interval from the 
sample data with the property that the mean value in repeated sampl¬ 
ing of the portion of the parent-frequency distribution lying over the in¬ 
terval is, e.gf., 99% and the variance of this portion of the parent fre¬ 
quency distribution is less than, say, 0.001. 

However, the solution to the statistical problem of tolerance limits 
is not the whole story in establishing realistic and workable specification 
tolerances, and there are usually a number of additional considerations 
of non-statistical nature which must be taken into account. For one 
thing, practical considerations of procurement render it frequently advi¬ 
sable to set up the specification limits so that they will include the ranges 
of variability of many manufacturers. Also, a specification must natur¬ 
ally depend heavily on the intended use of the material or item. Thus 



iOHN H. CUBTISS ^53 

engineering and economic considerations must be the final determining 
factor in the preparation of a specification. 

It has been found that the following set of rules provides a useful 
guide to the solution of the problem of setting up specification tolerance 
limits for a characteristic such as a dimension, or a physical property, 
or an element of a chemical composition. (No pretense to completeness 
is made here, and the circumstances of different cases necessitate many 
deviations from the formula.) 

(a) Obtain test data for material from as many of the prospective 
sources of supply as possible. 

(b) Perform tests of statistical hypotheses to determine whether or 
not the frequency distributions of the different sources of supply are 
significantly different. (If for example, the dispersions of all the sources 
of supply are not significantly different, then all the data for all sources 
can usually be pooled together for a more accurate estimate of a hypo¬ 
thesized common dispersion.) 

(c) Set up a solution of the statistical problem of tolerance limits 
for each statistically distinct source of supply. 

(d) By synthesizing the information obtained in (c) with knowledge 
as to the engineering requirements of the material and the procurement 
situation, establish allowable extreme values for the statistical tolerance 
limits of any possible source of supply. 

In performing the steps outlined above, it is possible in certain cases 
to use laboratory data from research projects in which the primary object 
was originally to compare one material or treatment with another. How¬ 
ever, a satisfactory test of the type of statistical hypotheses involved 
in research projects often requires a smaller amount of data than the 
amount needed to estimate population parameters with the accuracy 
necessary for specification purposes. Moreover, when the results of 
research are to be used as a practical yardstick which will be used day 
in and day out to measure the quality of purchased fiiaterial, various 
manufacturing testing variables are sure to enter into the picture which 
were not entirely foreseen in the research stage. It is well to emphasize 
in this connection that when a specification limit is being set up for some 
physical or chemical characteristic of a material, the population which 
must be studied is the population of apparent values of the characteristic 
as revealed by test data. Thus the dispersion of the population must 
include the component due to the error (or lack of precision) of the test, 
which in routine inspection fe likely to be greater than in a laboratory 
experiment. Tfiftrefore in many cases the only practicable way of setting 
up tolerance limits in accordance with the rules given above consists in 
taking sample units from the current production of several reliable manu¬ 
facturers and putting these units through the proposed tests in a manner 
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which seems to be representative of the way in which routine inspection 
tests will be conducted. 

Statistically based tolerance limits derived from routine inspection 
test data were written into a large number of Navy Department purchase 
specifications during the war. Some of the materials covered by these 
specifications were; heat treated glass, fiber glass, resistance wire, electric 
cable, electrical insulation of various types, chemical compounds, re¬ 
fractory materials, rubber products, meters and measuring devices, 
insecticide dispensers, wood products, rope and yarn, various plastics, 
life saving devices, electronic equipment, and many different metallur¬ 
gical materials and products. 

The problem of setting up sampling plans for specifications will now 
be discussed. The theory and practice of statistically based industrial 
sampling plans has been treated extensively in the literature and only 
the aspects of industrial sampling most closely related to the writing of 
specifications will be touched upon here. 

When sampling requirements are written into a specification which is 
supposed to have some measure of permanence, the chief problem of 
course is to prepare instructions which can be followed under a wide 
variety of procurement situations and inspection arrangements, and 
which will at the same time be sufficiently succinct and simple so that 
field inspectors and contractors will not be confused and antagonized. 
The older method of dealing with the problem consisted in omitting 
entirely any instructions as regards sampling for visual inspection (that 
is, surface inspection of individual units for obvious flaws, gauging of 
dimensions of units, weighing of units), and setting up very weak sampl¬ 
ing plans for laboratory tests. As examples of such plans the following 
are typical ; (a) Test one unit in each sub-lot of 250; if this, unit fails, 
reject only that particular sub-lot; (b) Subject two sample boiler tubes 
to a certain physical test ; if any fail, subject two more to the test, and 
accept the lot only if the latter two pass the test. It should be added 
that the definition of lot was usually very vague in the older specifica¬ 
tions, and direct instructions as to when to reject were often absent. 

On the other hand, in defense of these weak plans, three arguments 
can be brought forward; (1) Material presented for inspection under 
a specification containing a stable and well-established set of design 
requirements is typically either almost 100% in conformance with these 
requirements, or there is a heavy percentage of non-conforming material 
(that is, the a priori distribution of the true percent defective tends to 
be U-shaped); (2) Purposive rather than random selection of samples 
(vas often intended and sometimes was actually practicable (the older 
editions of the Navy’s general instructions to inspectors directed that 
samples,should always be chosen so as to represent the poorest part of 
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the material offered for delivery); (3) Lack of precision in methods of 
test tends to increase the producer’s risk at the high quality levels, so 
that the contractor should be allowed the benefit of doubt as much as 
possible. 

Since laboratory tests are frequently expensive and destructive, the 
above arguments suggest that it is appropriate in general to set up for 
such tests sampling plans which employ low sample sizes and (if the 
sampling is by attributes) zero acceptance numbers. Plans which are as 
weak as the examples cited above are not to be recommended, however, 
except in the rare case in which the authorized representatives of vendors 
and purchasers, in full awareness of the operating characteristic of such 
a plan, have come to a rationally based agreement that the plan is appro¬ 
priate. In the case of single sampling by attributes, sample sizes of 
from two to fifteen, with acceptance number of zero or one, will often 
be found to be satisfactory. It is of course assumed that each plan is 
rationally selected by combining knowledge of its operating characteris¬ 
tic or average outgoing quality limit with knowledge as to the nature 
of the tests and the quality history of various key suppliers. In the 
case of a non-zero acceptance number, the equivalent double or sequen¬ 
tial plan can conveniently be written out in the specification instead of 
the single sampling plan imtfiied by the foregoing discussion, but this 
should be done only with first-hand knowledge of probable inspection 
arrangements. The entire inspection procedure should be carefully sup¬ 
plied with the sampling plan: the definition of a sampling lot for pur¬ 
poses of the test should clearly be given, the method of sampling (whe¬ 
ther purposive or random) should be stated, the order of performing 
tests on the sample units should be specified, and rejection provisions 
should be explicitly written out. 

The situation is rather different with visual or surface inspection, 
which, as was previously stated, has been generally neglected in writing 
sampling requirements for specifications. Here intermediate percents 
defective are often encountered, so that a priori distributions may not 
be U-shaped; and indeed, for some types of surface defects an inter- 
jnediate percent defective may be considered entirely tolerable. Also, 
purposive sampling can seldom be used. These considerations militate 
against the use of simple, easily written out sampling plans with small 
sample sizes and low acceptance numbers. Yet experience proves that if 
inspectors and contractors are given no instructions at all, haphazard and 
ineffective inspection will surely be the rule rather than the exception. 

A satisfactory solution seems to be as follows: Assume sampling 
by attributes. Prepare as part of the specification, or as a supplement 
thereto, an exhaustive catalogue of visual defects, classified as major 
or minor. Publish in the specification for each classification either an 
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** acceptable quality level ” (AQL) in terms of true long-term percent de¬ 
fective (that is, a percent defective which should entail a sampling rejec¬ 
tion only a nominal proportion of times, say one time in twenty); or, if 
100% inspection of rejected lots is feasible, publish an average outgoing 
quality limit (AOQL) for each class of defects. Prepare and place in 
the hands of the inspectors a compendium of attributes sampling plans, 
arranged primarily according to AQL and AOQL, and secondarily 
according to lot size, severity of inspection, and other factors. In a series 
of specifications, this compendium should be given the status of a standard 
appendix to each individual specification. The understanding then is 
that the inspector will select from the compendium what he considers to 
be an appropriate plan with the specified AQL or AOQL. The plan will 
involve heavy or light sampling in accordance with the quality history 
of the individual supplier; the compendium should contain objective 
criteria to guide the inspector in his choice of plans within AQL or AOQL 
groups. 

With the publication of Appendix X of the Navy Department’s General 
Specifications for the Inspection of Naval Material, a system of incor¬ 
porating visual inspection provisions into Navy Department specifications 
similar tothe one outlined above was inaugurated. Appendix X 
appeared after the termination of World War II, and sinceac tivity in 
the preparation and revision of Navy Department Specifications has not 
been carried on at a high level in the postwar period, there has been no 
extensive experience with the system. During the war, explicit ration¬ 
ally based sampling plans for both laboratory tests and for surface ins¬ 
pection were incorporated into over 1000 Navy Department Specifica¬ 
tions; the large majority of the plans were statistically based. 

In conclusion, it should be stated that the operation of acceptance 
sampling plans is always made more successful by the exhibition and 
study of the inspection data on Shewhart control charts. The appli¬ 
cability of this statement to sampling requirements in specifications is 
borne out by extensive wartime experience with the use of such charts 
in connection with specifications for insecticide dispensers, pneumatic 
life preservers, mess gear, and many other items of equipment, • 


R48uiii4 

L’auteur distingue deux types fondamentaux d’6nonc6s rencontres 
dans les specifications pour produits manufactures et matiferes premi¬ 
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conditions d'acceptation (acceptance requirements). Ces clerniferes se 
subdivisent en conditions d'echantiUonnage (sampling requirements) et 
methodes d'inspection (methods of test). 

Les techniques statistiques principales pour Tetablissement des con¬ 
ditions de plan et des conditions d’echantillonnage (mais non pour I’ela- 
boration des methodes d’inspection) sont ensuite discutees. 

Le proced6 statistique principal pour I’etablissement des conditions 
de plan est Testimation dans le sens de F i s h e r, particulierement des 
percentiles et des intervalles centraux d’une loi de distribution (le pro- 
bl^me des limites de tolerance dans la litterature statistique). Cepen- 
dant, la solution theorique de ces problemes d’estimation n’est pas suffi- 
sante en pratique ct doit etre modifiee par Tintroduction de conside¬ 
rations technologiques et de faits resultant des possibilites d’achat. 

Dans r^laboration des conditions d’echantillonnage, deux problemes 
se pr6sentent: celui des plans d’echantillomiage (sampling plans) pour 
I’inspection destructive ou couteuse, et celiii des plans d’echantillonnage 
pour I’inspection visuelle non-destructive. Dans le premier cas, il est 
avantageux d’employer de petits echantillons et—pour des echantillon- 
nages par attributs”—de trfes petits nombrcs d’acceptations (accep¬ 
tance numbers). Dans le second cas, d’autre part, il est preferable de 
pr6parer et mettre k la disposition d’inspecteurs une collection de plans 
d’6chantillonnage auxquels les specifications se referent en donnant 
des niveaux de qnalite acceptable (acceptable quality levels) ou des limites 
pour la qualite moyenne de Varticle (average outgoing quality limits), 
pour les divers types de defectuosites. Dans I’un et dans I’autre cas, 
des instructions precises pour la methode d’inspection et Taction qui 
dojt en resulter, doivent etre formulees Tusage des inspecteurs. 


Discussion 

Mr. Delaporte noted that the usual literature on quality control 
assumes incorrectly that quality is always normally distributed. 

Mr. W. R. Thompson indicated that he has investigated statisti¬ 
cal methods not involving assumption of the normal distribution, and 
has developed the general expressions for evaluating any percentile and 
interval on which one may express a confidence (a definite probability) 
that the percentile lies in that interval. 



THE DEPENDENCE OF EARNINGS ON 
CHOICE OF SPECIFICATIONS 

by Merrill M. Flood 

Assistant Deputy Director of Research and Development 
General Staff, United States Army 

Introduction 

Earnings of a company depend upon many factors of management and 
chance. The choice of products, and their detailed specifications, is 
an important management problem. This problem is outlined in the 
present paper from the point of view of the statistical engineer. The 
discussion is referred to an example taken from the glass container in¬ 
dustry. The remarks are easily translated to apply to other commodities 
or services. The object of this brief note is to indicate the principal 
points at which modern methods of analysis arc applicable in the solu¬ 
tion of a broad problem of industrial management. 

The estimation of the likely effect, on company earnings, of a proposed 
minor change in specifications, for one of its standard products, is the 
principal problem discussed. Techniques that are suitable for this esti¬ 
mation problem can usually be applied to the more difficult estimation 
problems associated with the effects of major changes in specifications, 
or with the substitution or addition of new products in the line of com¬ 
modities placed on the market by the company. 

Three broadly different methods of approach to the problem are 
available: 

a) A priori. Theoretical estimation of demand for the product and 
of costs for engineering, production, distribution, financing, and man- 
agement. 

b) Experiential, Statistical analysis of past earnings of various 
companies with closely related specifications. 

c) Experimental, Limited trial of the change and observation of the 
effect on earnings. 

These same three methods, and combinations of them, can be considered 
for use in nearly ‘any situation where the likely effect of any action is 
to be estimated. They are discussed in turn, and are made concrete 
by an example taken from the glass container industry. 

Example 

The example concerns a manufacturer of glass tumblers who serves 
the hotel and restaurant trade, and operates under procedures long 
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established for the production and distribution of a tumbler that is the 
company’s only important product. It is assumed that the company has 
under consideration a proposal to alter a physical dimension of the 
tumbler, and desires an estimate of the likely effect on its earnings of 
the proposed change in specifications. The only characteristic of the 
tumbler that is of real importance to the trade, other than the selling 
price, is durability as indicated by the number of times the tumbler 
can normally be used before it breaks and must be replaced. 

A PBiOBi Method 

The a priori method starts with the preparation of detailed plans 
for the changes necessary in procedures for production, distribution, 
financing, and management. Cost and time estimates are then made for 
the engineering work necessary to complete the development and testing 
of the new product, and for all other important procedural changes. 
Finally, demand is estimated, market price is established on the basi 
of cost estimates and planned production schedules, and earnings are 
estimated. 

Statistical methods may well be applied during the planning and 
estimating stage in connection with the following: 

a) Design of laboratory experiments anticipated for the development 
stage. 

b) Design of laboratory and field tests that will be necessary to 
measure the likely performance of the new product. 

c) Design of plans for process control, sampling inspection, and 
lot acceptance based on the pertinent altered properties of the product 
that will result from a successful development. 

d) Estimation of likely output characteristics of the altered pro¬ 
duction process, such as: percentage rework and rejects, and average 
outgoing quality level. 

e) Design of advertising tests, and market investigations, that are 
to be conducted prior to the actual sales campaign for the new product, 
if development is successful. 

f) Design and interpretation of tests to measure the probable demand 
for the new product. 

g) Design of packaging tests, both for sales and shipping purposes, 
including tests to measure likely damage during production, distribution, 
and storage. 

h) Analyses to determine optimum lot size, capital and facility 
requirements, and optimum values of other management factors that 
depend upon performance characteristics of the product or that vary 
with other changes in the production or distribution processes. 
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This list indicates the complexity of the problem if it is approached 
from first principles. In practice, the a priori method is seldom used, 
even in part. It is discussed in this paper in order to provide a partial 
enumeration of the factors underlying the main problem. 

Experiential Method 

The experiential method starts with the collection of data on earnings, 
specifications, and pertinent management factors for several manufac¬ 
turers, or for one manufacturer during several different periods, who 
have produced and marketed items with specifications closely related 
to those in question. The auccessfuj application of this method requires 
that a sufficiently accurate relationship be established between earnings 
and a battery of related factors, including the specification variables 
under consideration. A set of appropriate values representing each 
product is then substituted for the dependent variables in the relation¬ 
ship and earnings are thus estimated for each alternative. 

The method is seldom useful when applied to data for several com¬ 
panies, may be subject to serious error arising from general business 
fiuctuations when a single company is analyzed over different time 
periods. It is most useful for a single company that has itself in the 
past offered a choice of similar products manufactured to slightly 
different specifications. 

An important example of the latter type is provided by an article that 
varies, in normal production, with respect to the specification under 
consideration. This case is often met, as for the tumbler example, 
with particular reference to the problem of determining the relationship 
between product durability and alternate choices of specifications. Use 
may be made of the principle that the stable renewal rate is inversely 
proportional to the durability of the product, thus making it possible 
easily to estimate relative durabilities as between products manufactured 
to different specifications. This is accomplished by comparing the fre¬ 
quency with which each type is Supplied with the frequency with which 
it is found in use. 


Experimental Method 

The experimental method staHs with the preparation of a plan for 
a test designed to provide direct evidence of the effect <5in earnings of 
a particular change in specifications. The initial planning work is then 
done, as for the a priori method, but estimates of costs, demand, and 
earnings arc eventually derived from data gathered during the test. 
The test data are interpreted in the same manner as in the experiential 
method. 
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The experimental method has the advantage that important variables 
can be controlled, and the collection of data can be arranged so as to 
provide observations in numbers adequate to yield estimates as precise 
as may be desired. The method is apt to be quite costly and very slow. 

The importance of careful and efficient test design can hardly be 
over-emphasized. Recent advances in the art and science of test plan¬ 
ning provide important new tools for the analyst. For example, the cost 
and time for a test can sometimes be reduced substantially by a sequen¬ 
tial variation of the arrangement as the experiment progresses. 

Conclusions 

It is concluded that careful analysis is usually required in order to 
estimate the magnitude and direction of effect on earnings of a particular 
change in specifications. As a working procedure for such an analysis 
it is usually desirable to start with a rough a priori study, next to check 
and strengthen this study with the help of data readily available from 
past experience, and finally to conduct an experiment designed to 
^provide new information of the type found to be most needed as a 
result of the preliminary analyses. 


R^sum^ 

Le montant des benefices tir6s d’une entreprise depend de nombre 
de facteurs aleatoires et de facteurs propres h Texploitation. Le choix 
de produits h manufacturer et la specification de leurs caract6ristiques 
pr6sentent des facteurs importants. L’auteur esquisse les probl^mes 
y relatifs du point de vue statistique. II se base sur un exemple 
pris dans Tindustrie des recipients en verre, mais les observations 
peuvent ais^ment s’appliquer k d’autres articles ou services. Ce bref 
memoire a simplement pour objet de signaler les points oh les m6tho- 
des modernes d’ahalyse peuvent etre appliqu^e k un probl^me trfes 
vaste de Pexploitation d’entreprises industrielles. 

Le point qui fait Tobjet principal de la discussion est revaluation 
des effets probables, sur le montant des benefices, en cas d’lm Mger 
changement dans les specifications d’un des produits-types. La tech¬ 
nique applicable dans ce cas pourra generalement etre utilised aussi 
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dans des cas plus diflSoiles oil il est question de modifications plus im- 
portantes, ou de la substitution d’un article ou de I’addition d’arti- 
des nouveaux k ceux mis sur le march6 par I’entreprise. 

Trois m^thodes diff^rentes peuvent ^tre utilis6es : 

a) a priori: estimation th^orique de la demande du produit en ques¬ 
tion et des frais de production, de distribution etc. 

b) d*experience: Analyse statistique des benefices r6alis6s ant6- 
rieurement par diflF4rentes entreprises manufacturant des produits sem- 
blables. 

c) experimentah: Essai du changement sur une 6chelle limit6e, 
et analyse de son influence sur les benefices. 

L’application de ces trois m6thodos, separ6ment ou en oombinaison, 
pent etre envisag^e dans presque toutes les circonstances oil il s’agit 
d’estimer les consequences probables d’une action quelconque. Dans 
ce memoire, chacune des trois methodes est discutee et illustree d’un 
exemple pris dans I’industrie des recipients en verre. 

L’auteur arrive k la conclusion qu’en general une analyse appro- 
fondie est necessaire pour Testimation qualitative et quantitative des 
effets d’un certain changement sur les benefices. Pour une telle ana- 
a e,iillys sernd iquo ordinairement de commencer par une etude a priori 
approximative, dont il faudra verifier et confirmer les resultats k I’aide 
des chiflfres qu’a fourni I’experience anterieure; enfin, on aura recours 
k une experimentation en vue d’obtenir les renseignements qui, suivant 
le resultat des analyses pr61iminaires, ont prouv6 etre necessaires. 
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RAPPORT SUR UNE ENQUETE INTERNATIONALE 
RELATIVE A L’ESTIMATION STATISTIQUE 
DES PARAMETRES 

Par Maurice Frechet 

FacuUe des Sciences de Paris (France) 

Tbxte db la cibculaibb bnvoy^.b 

De nombreuses controverses ont eu lieu recemment autour des metho- 
des d’estimation des paramfetres d’une loi de probabilite. 

Ces m6thodes concernent le problfemo fondamental de la statistique, 
celui des sondages en vue des previsions, celui consistant k conclure de 
la partie au tout. 

II parait done opportun et meme urgent de confronter les diverses 
opinions et de faciliter leur comparaison en les concentrant sur un seul 
exemple. 

Le Bureau de Flnstitut International de Statistique a d6cide de pro- 
voquer une enquete, ouverte k tons, sur ce sujet.. 

Choix du probleme ,—^Dans Texpose des methodes d'estimation, ou 
dans leurs applications a un problfeme determine, les raisonnements 
pr6sentes sont souvent obscurcis par I’intervention de calculs mathfema- 
tiques complexes n6cessit6s par les examples traites, calculs qui pour- 
tant ne touchent pas au fond des questions^n litige, lesquelbs ne reinvent 
que des principes du Calcul des Probabilites et du sens commun. On 
eliminera done celles des considerations math6matiques qui nesont 
qu’accessoires en se limitant k un problfeme particuliferement simple. 

Question posee ,—^Un 6venement E a et6 observe r fois dans n 6preu- 
ves. Sachant (ou admettant) que E y avait une probabilite constante 
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(mais inoonnue) p, quo peut-on dire sur la valour inconnue de p, oonnais- 
sant seulement n et le nombre r de repetitions de E (ou sa frequence 
f=^rln)i 

A-t-on des objections (et lesqueUes?) k faire contre Tune ou Tautre 
des methodes connues qui donnent une reponse k cette question? 

Pour simplifier k la fois la reponse et la comparaison des reponses, 
on ne demande d’examiner que le cas oil w = 1 et r = 1. 

[II importe peu que; vu le petit nombre d’epreuves envisage (une 
seul!), la reponse ne puisse restreindre que trfes peu (et mSme d’une fa 9 on 
inefficace en pratique) Tincertitude sur la valeur de p. Seules la pos- 
sibilite et la justification de cette restriction sont en cause ici.] 

Introduction 

II existe deux categories de personnes s’occupant de calcul des pro- 
babilites ou de statistique mathematique. Dans la premiere nous pla- 
9 on 8 ceux qui ont fait de ces sujets leur occupation principals ou Tune de 
leurs occupations principales. Dans la seconds, nous rangeons ceux 
pour qui, tres legitimement, ces deux sciences ne sont que des moyens 
en vue de leur utilisation pour une technique ou une science tout autre. 
Ces demiers ont besoin de recettes toutes faites, ils doivent pouvoir 
accepter celles-ci comme on accepte Tordonnance d’un m6decin. II 
importe alors que les membres de la premifere cat6gorie ne donnent pas 
en touts occasion, k ceux de la seconde, Timpression de s6curite k laquelle 
conduit souvent Temploi des math6matiques, s6curit6 qui existe, en 
efifet, mais seulement du passage des hypotheses aux conclusions, mais 
qui cesse aux deux extremites. Or, tr^s souvent, cette reserve n’est 
pas mise suffisamment en lumiere. 

En particulier, les biologistes, les psychologues, les ing6nieurs, etc., 
qui usent des methodes d’6stimation statistique des paramfetres ne sont 
pas toujours trfes bien inform^s par les manuels de statistique mathe¬ 
matique de la signification exacte des tests de signification, des inter- 
valles de confiance et surtout des coefficients de confiance et des proba- 
bilites fiduciaires. En outre, ils ne savent pas qu41 y a entre les math^- 
maticiens de graves divergences sur ces sujets, qu’il n’y a meme pas 
deux ecoles tranch^es, mais une vari6t6 infinie d’opinions. 

II nous a done sembl6 utile de porter ces divergences k la connaissance 
directe de tous les membres de Tlnstitut. International de Statistique, 
par le moyen d’une enquSte. 

“Le probl^me que vous posez,—^nous 6crit M. V i 11 e—^bien qu’ayant 
une allure paradoxale,^ est en efifet le problfeme central du calcul des 

» II a’agit ^videmment de la reduction ^ I’unit^ du nombre des ^preuvesconsid^r^s 
dans I’enquete, 
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probabilit^s. Si on ne pent r^soudre ce problfeme, on ne pent en r6soudre 
aucun... Je dois vous avouer ma crainte quo Ton ne puisse obtenir une 
r6ponse definitive; mais si vans parvenez k faire admettre que le pro- 
bieme tel qu’il est pos6, et pas un autre, est bien le problfeme crucial, 
le r6sultat sera loin d’etre negligeable.” 

Nous partageons la meme crainte que M. V i 11 e , mais nous avons I’es- 
poir que cette enquete contribuera tout au moins rendre plus claires 
et plus precises les objections aux differentes m6thodes et surtout k 
leurs interpretations, et, ce faisant, k eiiminer quelques unes de ces ob¬ 
jections et k rapprocher les points de vue. D’autant que ces resultats, 
qui seront, selon nous, atteints dans ce rapport par la simple confron¬ 
tation des doctrines, pourront etre pousses plus lorn grfi.ce k la discus¬ 
sion k laquelle il donnera lieu k la session de Washington. 

Nous sommes heureux d’avoir vu le Bureau de notre Institut accepter 
ce point de vue et nous le remercions de nous avoir fait Thonneur de 
nous charger du rapport sur cette enquete. 

Nous ne pouvions naturellement citer dans ce rapport que des extraits 
des reponses qui nous sont parvenues. Aussi, recommandons-nous 
au lecteur de prendre coimaissance des textes in extenso des reponses 
qui suivent ce rapport et dont celui-ci n’est qu’une preface. 

Signalons, en outre, que des questions analogues ont 6t6 trait6es k un 
colloque organis6 k Atlantic City (U.S.A.), en Janvier 1947, par la bran- 
che am^ricaine de la Society 6conom6trique, par Flnstitut (am6ricain) 
de Statistique mathematique et par I’Association am6ricaine de Statis- 
tique. 

D’autre part, rappelons que M. G i n i a fait, sur la question de I’es- 
timation des paramfetres, ainsi que sur d’autres questions fondamentales 
de la statistique un certain nombre de conferences publi6es par la So- 
oi6t6 Statistique italienne, conferences pleines d’exemples suggestifs 
et de r6flexions utiles k m^diter sinon k adopter entiferement (voir plus 
loin), mais que nous ne pourrions r6sumer ici. Elies ont 6te fondues 
par I’auteur en un expose systematique sous le titre: '^Intorno alle 
hasi logiche e alia portaia gnoseologica del metodo statistico'^ {Statistica, 
1946/46). 

Enfin, M. Kolmogoroff^a publie pendant la guerre un trfes 
important m6moire sur I’estimation des paramfetres, memoire que nous 
n’avons pas eu en mains au moment de la redaction de ce rapport mais 
qui semble pr6senter entre les thfeses qui s’affrontent le point de vue 
intermfidiaire auquel il faudra probablement se rallier (voir plus loin). 

* “Sur I’estimation statistique des param^tres de la loi de Gauss,” BvlL Acad, 
Sdencea s4rie math. 6 (1942), pp. 3-32. 
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Lkx axiomes bt leur interpretation 

Pour traitor clairement le probl^me de I’estimation, il est essentiel 
d’6tablir une distinction entre la th^orie axiomatique et mathematique 
de la probability d^une part, son application k la ryalit6 de Tautro. 

Tous les mathymaticiens s’accordent sur la thyorie mathymatique 
de la probability. S’ils dififferent sur la dyfinition de la probability, c’est 
en tant que celle-ci fournit une interprytation applicable au monde sen¬ 
sible, Ceci ytant, nous pourrons affirmer, en particulier que la connais- 
sance de la fryquence / = rjii d’un yvynement E de probability p dans 
n ypreuves ne fournit k elle seule, et ne peut fournir, aucun renseigne- 
merit sur la valeur de cette probability p (et ceci quelle que soit la valeur 
considyrye, petite ou grande, mais finie, de n) qmnd on s'en tient h la 
theorie axiomatique et mathematique de la probabilitL 

M. B o r e 1 a evaluy k 1/10^®®® une probability nygligeable k I’ychelle 
cosmique. II s’agit ici d’une application k la nature, de la notion mathy: 
matique de probability. Mais si nous sommcs tous d’accord (avec M. 
Borel) pour ne tenir aucun compte pratique d’une yventuality ayant 
une telle probability, par centre, absolument rien ne nous autorise ^ 
en faire autant dans la thyorie mathematique.® A plus forte raison, 
en sera-t-il de memo pour les frequences. Qu’un yvynement de pro¬ 
bability dyterminye se fypyte 10^®®® fois dans 10^®®® yprevues, rien dans 
la thyorie mathymatique n’empyche de supposer qu’en continuant la 
suit d’ypreuves, il cesse de se rypeter constamment et que, sa probability 
soit egale, par exemple, k un tiers. 

M- von Mises ecrit:^ “la ryponse k Tenquete est simple, brfeve et 
prycise dans le cas oh w = 1, r = 1 ... La reponse est: Bien. Aucune 
inference ne peut etre tirye du rysultat d’une epreuve ou, comme on 
le verra plus loin, d’un petit nombre d’ypreuves.” 

Aussi quand M. N e y m a n ycrit: “L’apparition de E un nombre de 
fois r au cours de n epreuves independantes n’implique rien au sujet 
de sa probability. En fait, cette dernihre peut avoir toute valeur de 
0 k 1,” il prycise quil faut ici donner au mot “implique” le sens “peut 
ytre^ymontry mathymatiquement.” 

M. Georges D a r m o i s fait ressortir dans sa ryponse que dans 
le cas r = 1, n = 1, on peut aj0&rmer que I’yvynement E est possible. 

» Et sans avoir besoin de I’interroger, nous savons bien que serait d’accord avec 
nous M. Borel, lul qui a introduit la notion fondamentale de convergence presque 
certaine (e’est-h-dire ayant lieu, sauf peut-^tre un cas de probability nulle), et a ainsi 
pu ajouter une prycision suppiymentaire immense et insoup^onnye au Thyoreme 
de Bernoulli. 

* Nous avons traduit en fran 9 ais les passages que nous dysirions citer, des ryponses 
rydigyes dans une autre longue. 
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D’ailleurs nous savons quo dans la th6orie axiomatique un 6v4nement 
(par exemple le choix d’un point donn6 sur un segment) peut etre possible 
et de probabilite nulle. 

Ainsi, il doit 6tre bien entendu que si un 6venement E se produit dans 
une 6preuve, la th^orie axiomatique ne s’oppose k aucune valeur de la 
probabilite a priori de p, iheme k la valeur zero. Comme nous le disions 
plus haut, il en est exactement de meme lorsque I’evenement s’est produit 
101000 fois aur iqiooo ^preuves. 

Il me parait extremement important d’insister sur ce point, bien qu’il 
soit evident, afin de bien faire ressortir la necessite de ne pas accepter 
les m^thodes d’estimation comme mathematiquement incontestables. 

Pour arriver dans le problfeme pose k une affirmation math6matique- 
ment demontrable, il faut: soit modifier les hypotheses, soit modifier la 
question posee, soit faire intervenir, a cote de la theorie axiomatique, 
une interpretation de la probabilite, interpretation qui peut varier d’un 
mathematicien k un autre. 

Premiere solution ,—^La manifere la plus simple d’operer est celle qui 
est preconisee avec de nombreux auteurs par M. Oskar Anderson: 
“Quant k loi des grands nombres et k sa consequence la theorie des 
intervalles de confiance—, je crois qu’elles ne peuvent etre basees 
que sur le lemme non-mathematique suivant enonce par Cournot: les 
evenements ayant de petites probabilites se realisent rarement.’' 

Et M. E e r a u d: “decidons d’adopter le degre de probabilite 
a = 1/10® c’est-lt-dire, de considerer que tout ensemble auquel est affecte 
une probabilite inferieure ou egale 1/10®- sera vide de resultat.” 

C'est la premifere des formes de raisonnement que nous avons exposees 
dans notre article de Portugaliae Mathematical^ 

“On peut faire le raisonnement suivant: admettons, comme on le 
fait sou vent, que si p est assez. petit—^par exemple, inferieur k un milli- 
onieme—on doit considerer JS, avant toute epreuve, comme evenement 
pratiquement impossible. C’est, au fait, la rfegle que nous appliquons 
journellement, consciemment ou non, pour ne pas nous soucier de cer¬ 
tains dangers dont la probabilite est trfes petite. 

Ceci 6tant, si la probability p de Tyv^nement E ytait inferieure k un 
millioniyme, on jugerait, avant toute ypreuve, E comme pratiquement 
impossible et on agirait en consyquence. Or, aprfes Tepreuve, on a con- 
staty que E s’ytait produit, Puisqu’on aurait juge, avant rypreuve, 
E comme pratiquement impossible, si p ytait inferieur k un millionifeme 
c’est done (et e’est ici qu’il convient de se demander si cette conclusion 
si’ impose) qu’on ne peut pratiquement supposer, aprys I’ypreuve, 

• “Fondements des m^thodes statistiques d’estimation,** Portugaliae Mathe^ 
maiica, Vol. 6 (1946), pp. 137.141, 
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p < I/IO®, Par consequent, dans ce mode de raisonnement, on doit 
conclure que j> est contenu dans^'l’intervalle de confiance** ou “rintervalle 

fiduciaire’* ^ ^ 1. 

D’ailleurs, on se contente souvent de determinations moins rigoureuses 
des cas pratiquement impossibles; on considerera souvent ainsi ceux 
dont la probabilite est inferieure k un millieme, un centieme. D’une fa 9 on 
generale, si la realisation d’un evenement est consideree comme peu 
probable quand sa probabilite est inferieure k un certain nombre 
(0 ^ ^ 1) alors, quand un evenement E de probabilite determinee 

mais inconnue, p, se realise dans une epreuve, on considerera comme 
peu vraisemblable que p ne soit pas dans Tintervalle 

(1) < P < 1 

et cet intervalle sera dit relatif au “coefficient de confiance’* 1 — « 
ou 4 la “probabilite fiduciaire” 1 — co. 

M. O. Anderson precise: “la limite de confiance diff^re non- 
seulement selon les individus, mais aussi suivant les divers degres d’im- 
portance d’un echec. Par exemple, la probabilite 1/100 d’une pluie 
imminente est negligee, mail il n’en est nullement de meme de celle 
d’une serieuse infection typhique ou choierique.” 

Nous avions ainsi continue: “Bien entendu, il ne saurait etre ques¬ 
tion de considerer 1 — cu , comme la probabilite que p appartienne ^ cet 
intervalle, puisque p, pax hypothfese, s’il est inconnu, est determine. 
C’est pourquoi, o> etant la probabilite la plus grande qui correspond k 
ce que nous avons appeie peu “probable,” nous nous sommes contentes 
de dire qu’il est peu “vraisemblable” quep n’appartienne pas ^I’inter- 
valle,® mais nous n’avons pas dit que cela est peu probable, puisqu’on 
sous entendrait que cette circonstance a une petite probabilite, alors 
que, pour le moment, du moins, nous ne saurions pas de quelle proba¬ 
bilite il s’agit.” 

L’interpretation ci-dessus de I’intervalle de confiance n’est d’ailleurs 
pas unanimement acceptee. 

Tout d’abord, certains statisticiens se refusent k examiner le cas 
d’une seule epreuve qui, disent-ils, ne peut fournir aucun renseignement 
utile. Si en effet, comme il est d’usage, ® est.un nombre petit, les ine- 
galites^ qu’on aura adopt6es, differeront si peu des inegalites 0 < p < 1 
qu’elles n’apporteront aucun renseignement utile. Cela est vrai, mais 
encore une fois, il s’agit ici surtout d’examiner la validite ou Tinterpre- 
tation de cette inegalite et non son utilite. 

«. Of. ‘*Fondements des m^thodea statistiques d’estimation,” op. dt. 

» Of. '^Fondements des m^thodes statistiques d'estixnation,’* op. cit. 
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Or les raisonnements qui peuvent 6tre mis en doute dans le cas n > 1 
pour conduire k un intervalle de confiance, sont exactement les m6mes 
que pour ti == 1 et sont en outre noy6s dans des calculs math4matiques 
qui ne sont pas en discussion ici. 

Une autr^ objection conceme la validity du lemme de Cournot, “La 
logique me permet pourtant, dit M. B i v i s i a, de penser que, considerer 
comme pratiquement impossible un coup que les mathematiciens appel- 
lent (dans leur terminologie vicieuse) hautement improbable, conduit 
k de Tabsurde, Le probl^me vrai de la conduite humaine consiste, 
non pas d; nier certaines possibilites mais k mettre en balance les conse¬ 
quences d’une 6ventualite quelle, qu’elle soit et I’effort ^ faire ou Fincon- 
v6nient k subir pour Teviter.’’ 

D’autre part, nous avions ecrit k ce sujet: “Nous allons donner un 
exemple des difiBicultes cachees qu’on rencontre, sans toujours s’en douter, 
dans ce genre de questions. 

Indiquons d’abord un cas sans difficultes cachees: on a une ume con- 
tenant 25 boules portant respectivement les 25 lettres de Talphabet. 
On en tire sept boules. Placees dans leur ordre de tirage, elles reprodui- 
sent le mot MIRACLE. Tout le monde pensera sans meme qu’il 
soit besoin de faire le calcul que le tirage a 6t6 truque: un tel ev6nement 
4tait pratiquement impossible. Sa probabilit6 

1 1 1 1 1 1 J. 1 

25 24 25 22 21 20 19 ^ (20)’ ^ 10® 

etait d’ailleurs, non seulement inferieure k un millioni^me; mais mille 
fois plus petite encore. 

Mais proc6dQns k un tirage non turqu6, on obtient par exemple 
C B A TI P S, Un tel tirage a la meme probabilit6 que celui du mot 

MIRACLE, elle est < 11 etait done, lui aussi, pratiquement impos 

sible avant Tepreuve et pourtant il a eu lieu. VoiUi le paradoxe. 

M. Dumas m’a fait tris justement observer que la probablit^ qu’il 
faudrait faire intervenir, cest plutot celle de Tapparition parmi les tirages 
possibles d’un tirage poss6dant un caract^re special: par exemple consti- 
tuant un mot du dictionnaire comme ici, ou bien pr^sentant les lettres 
dans un order alphab^tique. Cette probabilit6 est 6gale k la pr6c6dente 
multipli^e par le nombre de tels tirages singuliers. Elle n’est done pas 
aussi faible que la pr6cedente. 

Mais ce qui provoque TStonnement e’est que nous nous rendons compte 
instinctivement, que de tels tirages singuliers sont rares parmi les autres 
c’est-lt-dire que, malgrS tout, la probability, mSme ainsi renforcye, reste 
encore extremement faible.” 

C’ytaient Ik des id^es an^ogues k celles qu’exprime ainsi M. Divisia, 
*‘ce qu’il y a d’improbable, ce n’est pas que le mot MIRACLE sorte, 

47 
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o’est que si j'ai annonc6 la sortie de ce mot, il sorte pr6cis6m©iit. Et 
il ©n est d© mSm© de CDATIPS ou de tel autre.’' 

D’apr&s M. d© P i n © 11 i, “il n’y a rien de frappant si un 6v6nem©nt 
trte peu probable—(que ce soit par exemple, le mot MIRACLE ou le mot 
CDATIBS) se realise ©t onne peut done, du fait de sa realisation conclure 
revenement avait une probabilite moins petite, de meme il n’y a aucune 
raison de soup 9 onn©r que le tirage ayant donn6 un resultat quelconque 
(MIRACLE ou CDATIPS) etait truque, ou en general, influence par une 
cause indeterminee.” 

M. von Mises resoud le paradox de la fa 9 on suivante: 

“Si le mot MIRACLE a-^ete forme, e’est peut-fetr© que la method© 
de tirage a favorise quelques combinaisons particuliferes, mais cela 
peut etre aussi qu’aucune irregularite de ce genre n© s’est presente©, 
c’est-ii-dir© qu’a la longue, chaque combinaison d© 7 lettres apparaitrait 
avec la memo frequence p = 4/10^®. Dans ce dernier cas, la method© 
de tirage sera dite regulifer© {unbiased) > Mais dans c© cas, il ©st done 
tout k fait indifferent que la probabilite soit 1/6 ou 4/10'® Il n’y a aucun 
sens k dir© qu’un evenement d© probabilite 1/10'® est “pratiquement 
impossible;” si Ton employait cette fa 9 on de parler d’une fa 9 on reguliere 
on devrait dire qu’aucune combinaison de 7 lettres n’est “pratiquement 
possible,” la signification dep = 1/10^® nest rien de plus ni d© moins que 
ceci: dans une suite sufficamment etendu I’evenement apparaitra avec 
cette frequence, aucune assertion additionnelle ou modifiant la precedent 
n’est justifiable.” 

Si nous comprenons bien JMM- de Finetti et von Mises, ils rejettent 
notre paradox© en le lemme d© Cournot (de meme par suite que revalua¬ 
tion do M. Borel cite© plus haut). 

Dans les “Fondements” nous avions propose des explications de c© 
paradox© compatibles avec le lemme de Cournot. 

“On peut dire: il est impossible de parler de la probabilite de cet evene¬ 
ment, puisque, avant I’epreuve, on n’aurait pas su d© quel evenement 
il s’agissait. L© paradox© provenait de ce qu’on parlait d’un evenement 
non defini d’avance. 

“On peut aussi dire, la* probabilite d© ce tirage, e’est la probabilite 
d’un evenement qui est defini comme etant I’evenement qui va se reali- 
ser: cette probabilite est done egale k I’unite et ne peut etre 1/10®. Il 
n’y a plus de paradox©.” 

Dans la premier© form© de raisonnement qui vient d’etre propose©, 
une fois choisie la valeur de o», comme correspondant k la plus grande 
valeur de la probabilite d’un 6venement pratiquement impossible,® 

» On peut tenir compte de I’objection de M. Divisia au lemme de Cournot en 
disant au Ijeu “d’6v6nemont pratiquement impossible,” “evenement traiti comnte 
pratiquement impossible.” 
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on aflSrme quand E s’est r6ali86 qu’il est pratiquement impossible qu’on 
n’ait pas <0 ^ p < 1. II n’y a pas de degr6 dans cette affirmation et 
elle ne suppose pas la connaissance d’autre renseignement que les valeurs 
r = 1, 71 = 1. 

La **Surprenance '*—Avant de passer au cas oil Ton aurait d’autres 
renseignements, signalons une curieuse notion introduite par M. Charles 
Jordan dans sa reponse et qui est justifiee par un raisonnement 
assez analogue au precedent. O’est la notion de ‘‘surprenance” (sur- 
prisingness) du r^sultat d’une 6preuve. Dans n epreuves sont obser¬ 
ves successivement fois I’evenement de probabilite pi, rg fois 
rev6nement de probabilite pg, ces evenements etant incompatibles 
et leur systeme exhaustif (2Pk = 1). 

Avant les epreuves, la probabilite qu’on obtienne ce systfeme etait 


a = 


... rg-! 




soit rj, la plus grande des valeurs du second membre quand on remplace 
les par tous les systfemes possibles de repetitions (Sr^ = n), Comme 
on devait plutot s’attendre k un systeme dont la probabilite 77 est la plus 
grande et s’attendre d’autant moins au systfeme observe que ® est plus 
petit, on sera surpris si 0 est petit et d’autant plus surpris que aS = 1 
0/’? est grand. C’est cette dernifere quantite que M, Jordan appeUe 
la “surprenance” du systfeme des repetitions observees. Dans le cas 
oil n == 1 et oil Ton appelle E^ I’evenement E^ on doit prendre Pi ^ p 
et 0 = p si est observe, 0 = ^ dans le cas contraire. Done si p < g, 
Tj = p, sinon rj = q, Dfes lors quand p < &i E a, ete observe, 
aS == 1 — pIp = 0, quand p < ^, aS = 1 — pjq. Si Ton veut que la realsa- 
tion de E apetite surprenance aS < ©, il faudra que p ^ 4 ouque 1 — p/g 
< w oiip > (1—a))/2—<«> . Comme 4 ^ (1 — <«>)/(2 — ©), il suffit que p 
soit dans Tintervalle de “non surprise’" 



<p < 1. 


On voit qu’on arrive 4 un rfesultat analogue au precedent, sauf qu’on 
n’a plus une interpretation aussi simple de la plus petite valeur admise 
pour p. 


NifecBSSiTis DE renseignements a priori 

Un grand nombre d’auteurs considferent pourtant qu’il est impossible 
de rien affirmer sur p connaissant seulement les valeurs de r det de n.. 
“Pour emettre une conclusion, dit M. von Mises, il est indispensable 
de se servir d’une information additionelle suffisante, prealable aux 
epreuves et concernant la structure de I’ensemble d’objets duquel I’ob- 
jet employe dans les fepreuves fut choisi.” Et d’aprfes M. Neyman, 
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^^qtielque conclusion sur la probability p serait possible si ... Ton saviat 
que la probability p est elle-myme une variable aiyatoire. Dans ce cas, 
la formule de Bayes pourrait ytre appliquye et le rysultat de cette appli¬ 
cation dypendrait de la connaissance de la fonction de distribution de 
jp.’* On sait en eflfet que ^if(p)dp est la probability yiymentaire a priori 
pour que la probability aiyatoire P soit comprise entre p et p-^rdp, la 
probability Pi(oL) pour que P > a quand ryvynement E s’est produit, 
est ygale au quotient 


Pt (a) = 


\]^Pf(p)dp 

{ J fip)^P 


Ainsi, sachant quelle ytait la loi de probability a priori de P, c*est-^-dire 
avant I’ypreuve, on sait calculer sa loi de probability a posteriori quand 
on sait que E s’est produit. 

D’aprfes M de Finetti: *‘Le problfeme et les mythodes (d’estimation 
des paramytres) n’ont de sens qu’en s’appuyant sur le raisonnement 
de Bayes, memo s’il est sous-entendu, dyguisy ou refusy. 

Mais qu’est-ce que la formule de Bayes? 

Ici se place une digression historique. 

En employant cette expression dans le texte de I’enquete, nous avons 
eu le tort de nous conformer k un usage fryquent mais historiquement 
incorrect. Au sens que nous y attachions, nous aurions dk dire: la for¬ 
mule de Bayes-Laplace. Et c’est bien en ce sens que I’entend M. 
Neyman puisqu’il exige pour I’appliquer la connaissance de la fonction 
f{p) de distribution de P. Or comme le rappelle M. von Mises dans sa re- 
ponse, Bayes n’a pas inclu dans sa formule “le facteur decisif” f{p). 
Et M. M o 1 i n a ecrit* que cette fonction “n’apparait ni explicitament 
ni implicitement dans I’essai de Bayes. Ce fait soulfeve la question de 
savoir si Bayes a eu ou non la moindre notion du problfeme genyral des 
causes.” Par centre, c’est certainement par inadvertance que M. von Mises 
attribue k Laplace la meme lacune que celle de Bayes. Le cas oil toutes 
les hypothyses (ou causes) n’ont pas la meme probability est formelle- 
ment considyry par Laplace, avec la formule gynyrale correspondante, 
aux pages 198-199 du tome VII de I’ydition de 1947 de ses Oeuvres. 
S’il est vrai qu’il a frequemment employe sa formule dans le cas ou les 
probabUitys a priori sont ygales, ce n’est nuUement parce qu’il consi- 
dyrait cette ygality comme allant de soi, mais uniquement pour simpli¬ 
fier le calcul. C’est ainsi que dans le myme volume, appliquant la for¬ 
mule de Bayes-Laplace au calcul de la probability pour que la somme 
des orbites soit comprise entre deux nombres donnys, Laplace a soin de 
spycifier k deux reprises (pour les planytes, p. 281 et pour les comytes. 


• Bayes" theorem* An eirpository pr^ntation. 
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p. 335) que son calcul est exact si toutes les inclinaisons sont 6galement 
possibles. Enfin, p. 489, il traite un exemple avec quatre hypotheses 
in6galement possibles.^® 

II semble done que ces passages de Laplace aient 6chapp6s k M. R. 
A. F i s h e r quand il 6crivait “ car Laplace prend pour allant de soi 
et sous une forme largement g6nerali8ee ce que Bayes avait desir6 es- 
sayer de postuler dans un cas special.** 


Choix d’unbj loi a pbiobi 


Admettant I’emploi de la formule de Bayes-Laplace, certains propo- 
sent (ou essaient) son application avec une loi de probabilit6 a priori 
bien d6finie. 

Par exemple, M. Eyraud note qu’en proposant que cette loi soit uni¬ 
forme, c*est-4-dire que f(p) = 1, on aurait pour la probability elemen- 


taire a posteriori^ quand a eu lieu, la valeur 


-A D'oil 

[Wp 


jPi(a) = j ^ 2pdp = 1 a*. La valeur dominante de la probability aletoire 

inconnue est alors 1, sa valeur moyenne 2/3, sa valeur ^qui-probable 




< 1), son ecart quadratique moyen 


1 

3V2’ 


Pour que Terreur commise, en supposant que p est dans un intervalle 
dytermin6, (a, y?), ait une probability au plus ygale y, a*, il faut que 

J ^ 2pdp u) oil ^ 1 

On a intyret k rendre cette estimation la plus prycise possible, e’est- 
y-dire k reduire la longueur de Tintervalle p — a. Or, celui-ci doit etre 




1 - (0 


Il faut done rendre maximum — \ ce qui a 

lieu pour /? = 1 et a — Vo). Ainsi Fintervalle de confiance qui ytait (w, 1) 
dans le premier raisonnement (p. 368), se trouve ryduit k Tintervalle plus 
petit (\/®> i)‘ Suivant la remarque gynyrale faite plus loin, onobtient 


8’il r^sulte cie ce qui precede que Laplace (et non Bayes) a explicitement 6crit 
la fonnule rigoureusement exacte dans tons les cas, la question reste ouverte de 
savoir si e’est Laplace qui I’a fait le premier. 

Inverse probability (Proc, Cambridge Philosophical Soc., Vol. XXVI, 193. p. 528) 
D’ailleurs Texpression probability inverse y est associ^e par M. Fisher au 
systyme formy par la formule de Bayes-Laplaee et par le postulat de I’ygale pro¬ 
bability a priorit alors que ce postulat est indypendeuit de I’idye d’inversion. 
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une precision plus grande quand on emploie la formule de Bayes. Mais 
tout ce raisonnement repose sur I’hypothfese de Bayes ^ savoir la repar¬ 
tition uniforme des probabilites, hypothfese qui peut etre conforme aux 
faits mais qui generalement ne le sera pas, comme Ta montre M. Gini. 
Et dans les cas oti elle 1© sera, on n*en aura pas toujours la preuve. 

M. Dumas propose une autre loi a priori. Pour diverses raisons qu’il 
expose dans sa r6ponse, il choisit une loi ‘‘virtuelle” /(p). C’est-li-dire 
qu’il applique la formule de Bayes-Laplace en prenant la limite du 
second membr© quand on y remplace /(p) par une suite de fonctions 
Stkp) sont des densites de probabilite, sans qu*il en soit ainsi pour 


leur limite/(p) qu’il prend ^gale ^. En prenant /n(p) =-—"— 

.p(l-p) P(l—p) 

entre ^ et 1 — i et 0 en dehors, on trouve pour la densite de probabilite 


et ou la fonction de repartition 


1 - p . 


a posteriori _______ 

^ (1 - p)L(n - 1) ^ L(n - 1) 

— L -Celle-ci entre - et 1 -, tend vers zero quand n oo pour 

n — 1 n n 


p < 1 et vers 1 quand p = 1. Par consequent, la probabilite a po^steriori 
n’est plus aieatoire (dans le cas examine oh r = 1, n = 1); elle est egale 
k 1 (presque certainement). Ses valeurs moyenne, equi-probable et 
dominante sont egales k 1. Peut-on, comme M. Dumas, en conclure 
que ce resultat est conforme au bon sens? Autremeht dit, si Ton sait 
seulement qu’une seule epreuve ayant ete faite Tevenement E s*est pro- 
duit, en conclurait-on comme allant de soi, que cet evenement devait 
certainement se produire? 


InCEBTITUDS sub JjA loi A PBIOBI 

MSme les partisans de Temploi de la formule de Bayes-Laplace doi- 
vent reconnaitre qu’il est souvent difi&cile de determiner exactement les 
lois de probabilite a priori. On peut tourner cette difficulte de Tune 
des deux manihres suivantes. 

D’abord en observant que, si Ton ne connait pas exactement la loi 
de probabilite a priori^ on a generalement quelques renseignements en 
dehors des valeurs de r et de w. D’aprfes M. Georges Darmois, “On 
sait en general, quelque chose sur Tinconnu que Ton cherche mais ce 
quelque chose n’est pas aussi precis qu’une loi de probabilite a priori, 
Et sans etre trhs precis, c’est pourtant. mieux que rien.” 

Appuyons par un exemple. 

Dans Tapplication du probieme actuel aux essais industriels, on em¬ 
ploie generalement la theorie soit comme si Ton ne savait rien, soit au 
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Contraire, comme si Ton connaissait des caract^ristiques (moyenne, 
-dispersion, ...) de la distribution des objets pouvant etre livr6s bu la 
distribution elle-mSmo. En fait, on ne sait rien de precis, mais on sait 
qu’on a affaire 4 des fournisseurs qui ne risquent de livrer pas plus 
des lampes en carton que des vis en or, et m6me, qui, non seulement 
s’bcarteront des termes du marche de fa 9 on beaucoup moins extrava- 
gante, mais, en fait, s’en rapprocheront de trbs prbs. II en resulte que 
si Ton connaissait la loi de probability a priori qui correspond k cette 
situation, on obtiendrait, une fois Tessai efifectub avec un resultat favo¬ 
rable, une probability a posteriori (que la livraison soit bonne) plus grande 
que la probability fidiiciaire ou le coeflBicient de confiance rysultant de 
cet essai, quantitys qui sont indypendantes de toute probability a priori, 
C’est ld» une circonstance favorable aux thyories indypendantes de la 
formule de Bayes-Laplace car il vaut mieux rejeter de bons lots comme 
mauvais (lots quo le fournisseur pourra d’ailleurs ryexaminer et repry- 
senter partiellement) que d’accepter de mauvais lots comme bons. 

Nous venons de nous appuyer sur une remarque intuitive. II est 
toutefois plus sur encore de la prouver mathymatiquement. C’est ce 
qu’a fait dans sa reponse, M. Georges Darmois en dymontrant que dans 
le cas ou la probability inconnue P de I’yvynement E a une loi de proba¬ 
bility a priori et oil cette loi a une densite de probability, la probability 
a posteriori p^ (a) que P soit supyrieur k un nombre positif a, est—quand 
dans une ypreuve E s’est produit—^supyrieure k la probability a priori 
PQ(a) de I’inegalite P > cc, I’ygality pi{a) = Po(a) ne pouvant avoir lieu 
que quand ces deux quantites sont nulles. 


Probabilites a priori appbochAb 

Revenons 4 I’incertitude des lois de probability a priori, Quand nous 
avons, en dehors des valeurs de r et de n, quelques renseignements sur 
les epreuves et Ics yvenements considyrys, il en resultera souvent que 
ces ypreuves et ces evynements peuvent etre ranges dans une “super¬ 
population” oil p est une variable aiyatoire. Bien que, comme dans 
Texemple prycydent des essais industriels, nous n’ayions gynyralement 
pas les moyens de deduire de nos renseignements sa loi de probability 
a priori, celle-ci est dyterminee par ces renseignements. Il arrivera 
alors parfois que ne sachant comment dyduire exactement f(p) de ces 
renseignements, nous puissions enfermer J(p) entre certaines limites 
fiiP)>MP)- C’est le cas (ou plutot le cas particulier oii/j et/j sont cons¬ 
tants) qui est signaiy par MM. Ville et F o r t e t. Appelons C la classe 
des fonctions comprises entre fi et /a. D’aprfes M. Fortet, on pourra 
considyrer comme vraies pour la loi de probability a posteriori de 'P cel¬ 
los des propriytys de cette loi qui sont communes k toutes les fonctions 
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de probability a posteriori oorrespondant anx fonctions de probability 
a priori comprises entre/i et/g. 

Dans le memo ordre d’idyes, M. von Mises indique iin mymoire oil il 
a montry comment, dans beaucoup de cas, quelques information gynyra- 
les sur f(p) permettent d’obtenir des inygalitys foumissant des renseigne- 
ments sur les probabilitys a posteriori, 

Un autre moyen, qui, d’apres M. Molina, dans son article city plus 
haut, a yty dyja employy par Laplace, Poincary, et Edgeworth, est sig- 
naiy par M. von Mises et M. Fortet. Ce dernier se contents de mention- 
ner que lorsque le nombre d’ypreuves est grand, les mythodes d*estima- 
tion indypendantes de la formule de Bayes-Laplace donnent asymptot- 
iquement le meme rysultat que cette formule, sous certaines conditions, 
d’ailleurs trfes gynyrales. M. von Mises signale que, pour un grand nom¬ 
bre d’ypreuves la probability a posteriori peut devenir indypendante 
de la loi de probability a priori et prycise dans sa ryponse un des sys- 
tymes de conditions suffisantes k cet effet: il considyre le cas, vraiment 
trys gynyral, oil f(p) est borny dans Tintervalle (0, 1) et est continu et 

0 pour p ygal k un certain nombre a (0 < a < 1). M. von Mises a 


prouvy que dans ce cas, si maintenant ~ a quand w oo et si Uu 
tTji, pi, P 2 sont des nombres tels que 


(2) _ Ui_ _ U 2 _ / n 

Pi — a P 2 ^ ^ 2a(l — a) 

alors la probability a posteriori pour que Pi < p < P 2 , est asympto- 

1 f 

tiquement equivalents k Tintygrale de Laplace 1 e ^ du laquelle— 

A/W J TT 




comme au rests la condition (2)—est indypendante de la fonction/(p). 

Par exemple, ajoute-t-il, si ^ a eu lieu dans la moitiy des ypreuves, 
la probability que p tombs entre 0.46 et 0.61 est environ 0.47 quand 
n = 1000 et environ 0.96 dans le cas oil = 10,000. 


Par contre, M. von Mises insists sur Timpossibility, dans le cas de pe¬ 
tite ychantillons, de conolure quoi que ce soit, sans connaitre la, struc¬ 
ture de la catygorie d’ypreuves oil P est choisi. Il indique k titre d’yxem- 
ple deux mymoires de 1931 oil a yty appliquye la thyorie des petits ychan¬ 
tillons (sans formule de Bayes) et oil elle a conduit k des rysultats qui 
sont, selon lui, contraires au bon sens. Nous teviendrons sur ce point 
plus loin. 


, OSJXCTIPNS A l’emPLOI DE LA EOBliULB DE BAYES-LaPLACE 

La discussion est ardente entre partisans et adversaires, nous ne dir- 
ons pas de la formule de Bayes-Laplace, qui est mathymatiquement 
jxidtecatable, mais de la possibility et de Tutility de son emploi pratique. 
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Les seconds consid&rent que la formule de Bayes-Laplace quoique 
pouvant servir dans quelques exemples concrets particuliers est g6n6- 
ralement inapplicable dans les probl&mes statistiques qui se pr6sentent 
dans la pratique et cela pour plusieurs raisons. Meme quand p peut 
etre consid^re comm'e une variable al6atoire, on ne connait pas sa loi de 
probability ou bien p peut etre d^fini dans plusieurs categories d’epreuves, 
dans plusieurs populations distinctes, ayant respectivement leurs lois 
de probability, qui peuvent etre distinctes et entre lesquelles on ne sait 
choisir. Plus encore, il arrive meme gynyralement que la probability 
de ryvynement considyry, E, a une valeur dyterminee dont on ne voit 
aucune raison de la considyrer comme Tune de celles qui se prysentent 
comme la probability d’un yvynement E choisie au hasard dans une fa- 
mille d ryvynement ou superpopulation. 

Par exemple, Mr. Bartlett ‘‘rejette Fusage quantitatif de la 
formule de Bayes-Laplace dans les problfemes d’estimation parce que 
les probabilitys a priori qu’elles contiennent—qu’on les regarde comme 
subjectives ou objectives—^ne sont pas, dans son opinion, des quan- 
titys auxquelles des valeurs uniqbes et connues peuvent etre 
attribuyes.” 

M. Derksen s’associe *‘aux critiques yievees par M. Fisher ... 
centre Fusage fait du thyor^me de Bayes pour la solution du problfeme 
de la possibility dite inverse.’’ Parmi ces critiques figurent celle qui 
concerne Fygality des probabilites a priori, C’est une hypothfese qui 
a yty en cffet, considerye par M. Pearson comme Fh 3 rpothyse h, adop¬ 
ter quand on ne sait rien sur les probabilitys a priori, Mais il semble 
bien que la tendance la plus rypandue actuellement parmi les partisans 
de la formule de Bayes-Laplace consiste h. n’avoir recours k cette hypo- 
thfese que dans deux cas, d’abord celui oh Fon a des raisons de penser 
que cette hypothyse est conforme aux faits, ensuite le cas ou le nombre 
d’ypreuves est grand et ou des thyorfemes analogues k celui de M. von 
Mises rappeiy plus haut montrent que cette hypothyse, qui facilite les 
calculs, ne modifie pas sensiblement les rysultats. 


Objections axtx estimations dibectbs 

D’autre part, si M. von Mises concyde que “dans beaucoup de pro- 
biymes, il est vrai que p (ou toute quantity dyduite de p) ne peut etre 
considyrye comme une variable aiyatoire,” il ajoute: “S’il n’est pas pos¬ 
sible d’imaginer que Fobjet de Fexpyrience peut varier de fa 9 on k cor- 
respondre h des valeurs diverses de p, comment peut-on parler de la 
chance que p tombe dans quelque intervalle? Et si des assertions sont 
ymises qui contiennent d’autres terms que chance ou probability, comme 
vraisemblance {likelihood), probability fiduciaire, niveau de confiance 
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ou de signiftcation, la preml&re chose k faire serait de donner clairemcnt 
des d6finitions opSratoires pour ces termes, ce qui est loin d’avoir en¬ 
core 6t6 fait.” 

Avec M. von Mises, MM. Dumas et Fortet sont d’avis quo ceux qui 
pr4tendent ne pas employer les probabilit^s a priori et recommandent 
des m4thodes d’estimation fondi6es sur la seule connaissance des valours 
de r et de n font en r6alit6 des h 3 rpothfeses implicites. 

II est seulement regrettable qu’aucun d’eux ne precise les points par- 
ticuliers de raisonnements oh de telles hypotheses cachees se sont 
glfss6es, 

D’ailleurs nous aUons voir comment on peut pr6senter la th6orie des 
intervalles de confiance de faqon h parer aux objections qu'elle a suscitees, 
pourvu qu’en memo temps, on se resigne k ahandonner certaines preten¬ 
tions. 

En effet, ces objections portent d’abord sur le cas oii une epreuve 
4taht faite et un r^sultat determine ayant ete observe: la realisation de 

il s’agit d’en conclure quelque chose sur p, sans s’occuper des autres 
epreuves qu’on pourrait faire, ni de leurs resultats possibles, sans s’oc¬ 
cuper de savoir ce que pourrait faire le meme observateur uno autre fois, 
(car on doit.considerer, par exemple, le cas oh il ne pourrait tenter I’ep- 
reuve qu’une fois dans sa vie). 

Dans ce cas, on ne voit pas du tout comment on pourrait attacker 
un sens k la probabilite que p, nombre inconnu mais determine, soit 
entre deux nombres donnes. Car comme le dit M, Fisher: “les pre¬ 
miers auteurs ayant etudie la logique des probabilites ont mis en evi¬ 
dence un point de la plus haute importance, qui est tres facilement neg¬ 
lige, k savoir que la probabilite est une qualite non d’un evenement 
particulier en soi, mais d’un evenement regarde comme membre typi- 
que d’une population bien definie d’evenements.” (Nous dirions d’ail¬ 
leurs plut6t “regarde comme pouvant etre realise ou non dans une popu¬ 
lation bien definie d’epreuves.”) Or dans la premifere forme du pro¬ 
blems pose, I’existence de cette population est exclue. 

Il semble bien resulter de ce qui precede que si Ton examine cotte 
forme du problems sans savoir rien d’autre que le nombre d’epreuves 
et la frequence de I’evenement, alors: ou bien Ton se restreint k la theo- 
rie axiomatique et Ton ne peut rigouretisement rien conclure sur p; ou 
bien malgre les objections qu’il souieve on adopts le lemme de Cournot 
ou un lemme analogue (comme celui de Charles Jordan concernant la 
“surprenance”) et on trouve que p est dans un intervalle. determine 
pratiquement. 

On peut donner au probieme, une seconds forme: si nous repetons 
repreuve, il pourra arriver que, dans certaines, ne se produise pas. 
Le problems resolu par la formule de Bayes-Laplace ne s’occupe pas 
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do ces dcrniires, il fournit la probability que dans la cat6gorie C d’^preu- 
ves ou E s’est realis6, p soit compris entre deux nombres donnes. Et 
cette categorie C est extraite de la catygorie d’ypreuves oh la probabi¬ 
lity a priori de p a la valeur qu*on lui a attribuye pour Tutiliser dans la 
formule do Bayes-Laplace. Si nous nous posons le problfeme de savoir 
quelle probability nous avons de nous tromper dans une affirmation 
concernant p quand nous n’ymettons de jugement qu’aprfes chacune 
des ypreuves oh E s’est ryalisy, “alors il semble, ycrit M. von Mises, que 
la mythode des intervalles de confiance, rejetant toute consideration 
de la distribution initiale, ne peut fournir aucune contribution k la ry* 
ponse de cette question particulifere.”^* 

Mais il y a certaines situations oil cette seconde forme du problfeme, 
que M. von Mises a eu raison de bien preciser, n’est pas celle qui est pra- 
tiquement a resoudre. Dans les essais industriels, par exemple, il s’agit, 
pour les operateurs, d’accepter ou de rejeter tel ou tel lot suivant le ry- 
sultat de Tepreuve. Il n’est pas alors possible d’affirmer que ces opyra- 
teurs ne se trompent jamais, mais il est important qu’ils se trompent 
le moins sou vent possible. 

Supposons maintenant qu’un operateur ait souvent k decider quelle 
val(3ur attribuer a p et a chaque fois d’aprfes le resultat d’une seule epreuve. 
epreuve. Et conseillons lui d’adopter la conclusion k laquelle nous avait 
conduit le lemme de Cournot, sans pourtant, cette fois, justifier cette 
methode par ce lemme. Nous disions dans le ‘‘Fondements des mytho- 
des statist! ques d’estimation”: 

“On peut adopter la rfegle suivante. On decide avant I’ypreuve, de 
se conformer, aprfes Tepreuve k la rfegle A a consistant: 

“Si E se produit, a affirtaier ensuite que <«* < p ^ 1, si no se produit 
pas, k affirmer ensuite que <*> ^ 1, c’est it-dire O^p^l —(tf, et 

dans les deux cas, d’agir en consequence. (Observons d’ailleurs que Ton 
ne pourrait avoir 1 — <o < p < <0, que si Ton suppose <*> > ce qui, du 
reste, n’a jamais lieu pratiquement, puisqu’on suppose qu’en ycrivant 
p < 0 ), on n’a pour p qu’une petite probability.) 

“Ceci etant, quelle est la probability P pour qu’on commette une erreur 
en appliquant cette r^gle? Si p < on aura commis une erreur si E 
s’est ryalisy: P = p < <*> si ^ < <*>, on aura commis une erreur si E ne s’est 
pas realise: P ^ q < <0. Enfin si a> < p < 1 — o), on ne commettra 
jamais d’erreur, que E se soit realise ou non; P = 0 < cd. 

“Ainsi I’cvencment G consistant k commettre une erreur en appli¬ 
quant la r^gle A03 ci-dessus est un evynement aleatoire qui a une proba¬ 
bility P, inconnue comme p, mais tout aussi bien determinye p et qui 
de plus est necessairement inferieure k o>. 

“On the correct use of Bayes’ formula,” Annals of Mathematical Statistics, Vol. 
XIII (1942) p. 165. 
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*‘La probabilit6 P qu’on a de faire une erreur en appliquant la r&gle 
Aq apri» r^preuve est d6termiii4e avant Vepreuve et elle est < cd. 
Faisons maintenant un grand nombre d’6preuves ind6pendantes, dans 
chaoune desquelles r6v6nement E a une probability determinye mais 
inoonnue, elle sera dytermince avant chaque ypreuve et toujours in- 
fyrieure h 

‘‘II en rysulte que si Ton un grand nombre d’ypreuves, et si, par ex- 
emple, <o = 1/10® on devra s’attendre, avant de commencer ces ypreuves, 
& ce que, dans ce grand nombre d’ypreuves, on ne fera qu’une erreur 
au plus sur environ un million de jugements basys sur la r^gle Au, C’est 
une second manifere de motiver les expressions de “coefficient de confi- 
ance ou de “probability fiduciaire” appliquyes 1 a>. 

“Notons bien qu’il s’agit toujours dans ce qui prycfede de probabilitys 
dyterminyes avant toute ypreuve et sans que la valeur (dyterminye) 
de p soit connue.’* 

C’est 111 la seule solution (au problfeme posy dans Fenquete) figurant 
dans les ryponses de MM. Geary, Kendall, Tippett, Darmois, 
M. P o r t e t, (ce dernier rappellant que M. Kolmogoroffa publife 
un article proposant aussi cette interprytation de confiance). Et M. 
N e y m a n prycise qu’ils adoptent cette interprytation quand il s’agit 
en effet de donner une rygle d’aotion—et de la motiver. M. Bart¬ 
lett distingue: “L’utility de cette solution dans chaque problfeme 
sera une question d’opinion. II est possible d’imaginer un type de pro- 
biyme, par exemple dans une suite d’essais industriels, ou de telles rfegles 
soient tout It fait justifiyes et un autre type, peut-etre d’un caractfere 
unique, ou la notion d’une estimation regardye seulement comme Tune 
d’une longue serie d’estimations, peut ytre plutot absurde.” 

En tous cas, en se pla 9 ant dans le premier cas envisagy par M. 
Bartlett, I’objection faite trfes justement et rappelee plus haut a 
une signification du coefficient de confinance 1—w comme une probability 
ou une chance calcuiye quand I’ypreuve est faite et relative It une valeur 
de p dyterminee avant I’essai, n’a plus de valeur car I’interpretation de 
l~ft) est celle d’une probability d’un yvynement non encore realise: west 
la plus grande valeur de la probability qu’on fera (au futur) une erreur 
en appliquant la rfegle Aa, “Sans doute, dit M. Darmois, la probability 
dont nous parlons est relative II la rfegle adoptye et, quand on I’a appli- 
quye aprfes I’ypreuve, on ne salt pas quelle chance on a d’avoir 
raison. II est myme difficile de donnbr un sens prycise II cette 
question...” 

II semble done qu’en adoptant cette interprytation de I’intervalle 
de confiance, on pourrait mettre d’accord partisans et adversaires de 
I’emploi de la formule de Bayes-Laplace. II resterait pourtant II dyter- 
miner quelle est la vyritable position prise par M. R. A. Fisher. 
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Par exemple, dans une de ses conferences, M. Fisher s’exprime ainsi: 
‘‘Cependant le point de vne par lequel je difffere de ceux de quelques 
autres statisticiens est que nous ne pouvons pas ignorer que nous ayons 
une connaissance certaine de O, C’est la raison meme pour laquelle nous 
avons pris notre echantillon.” En repla 9 ant cette phrase dans son teste, 
il semble bien en r^sulter que M. Fisher repousse, pour la probability 
fiduciaire, la planche de salut constitute par Tintervention d’une rfegle 
d’action applicable a tous les cas possibles. 

Dts lors, il semblerait que les critiques formulees k Tencontre de la 
probability fiduciaire par d’aussi yminents statisticiens que MM. Serge 
Bernstein, Gini et von Mise s, si elles ne s’appliquent pas k 
Tinterprytation par la rtgle Ai^ pourraient s’appliquer au point de vue 
de M. Fisher et en tout cas s’appliquent certainement aux exposts de 
plusieurs de ses disciples. 

C’est ainsi que, selon M. Gini: “M. R. A. Fisher, dans un mymoire 
de 1930, regarde comme tvident—car il ne le prouve pas que s’il y a une 
probability de 0.95 (ou 0.997) par exemple, que la valeur obseryte, i, 
d’une grandeur ... d’intensite donnce g ... excede la limite F, alors il y a 
aussi la probability 0.95 (ou 0.997) que, ayant obseryt une valeur E, la va¬ 
leur de la grandeur reste inferieure k $. Fisher ne fait pas d’autre hypo- 
thfese que la continuity de t. Mais la penste de M. Fisher est fluide et vari¬ 
able. D’une part, il semble avoir depuis ajoutt une autre hypothfese k 
oelle de la continuity: cello que la fonction envisagte est ce qu’il appelle 
“efficient.” D’autre part, dans une lettre privee oii je lui signalais qu’un 
de ses disciples avait adopty I’yquivalence entre probabilitys distinctes 
signaiyes ci-dessus par M. Gini, M. Fisher avait refusy d’en assumer la 
responsability et d’accepter cette equivalence. Tout cela n’aurait pas 
d’importance si nous ne nous trouvions avoir affaire ici k un statisticien 
dont la ryputation est legitimement mondiale et dont nous ne pouvons 
negliger les ycrits. Or nous arrivons k ce dilemme: Ou bien I’inter- 
prytation due k M. Fisher de la probability fiduciaire est inacceptable, 
ou bien dans le cas oh cette interprytation serait valable, les plus grands 
statisticiens I’auraient comprise inexactement et il faudrait en conclure 
que cette interpretation ytait obscure. Il serait done urgent d’en donner, 
dans les ouvrages de statistique adoptant les theories de M. Fisher, 
un exposy assez clair pour qu’elle ne puisse faire hesiter pas plus les simples 
usagers de la statistique ceux qui ont apporte a cette science d’importantes 
contributions. M. E. B. W ilson ecrit par ailleurs: “Il y a beau- 
coup de cours sur la statistique et un nouveau livre sur ce sujet apparait 
sur le marchy k peu prfes tous les deux mois. Quel est le niveau intellec- 
tuel de ces cours et de ces livres? Pour la plupart, autant que j’en 
puisse juger, ce niveau est le plus bas qu’on puisse imaginer... 
On y presente une quantity de tables, de methodes de calcul, de 
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tableaux pr6par6s, en n^gligeant leur analyse logique..., sans une 
introduction substantiell© au calcul des probabilities® qui, avec la 
logique, fournit le seul fondement solide sur lequel peut reposer une 
saine comprihension de cette science difficile et traitress© qu’est la 
statistique.” 


Influence db la conception db la probabiliti^ 

Notons que dans le raisonnement relatif ^ la probabilite d’erreur 
de la rigle il h*a pas iti nicessaire de faire appel, en dehors de la 
thiorie axiomatique des probabilitis, h, son interpretation, dans le monde 
sensible. Cette interpritation intervient au contraire, au moment 
oil sachant que P < w, on doit decider s’il est bon d’appliquer la regie 
P peut etre intei^reti par exemple, comme le font MM. Finetti 
©t Fortet, comm© un degri de croyance, ou suivant la difinition classique 
de Laplace (encore trfes giniralement adoptie), ou suivant M. von Mises 
comme une limite d© friquences. M. Neyman adopt© une difinition 
qui a en commun avec cell© de M. von Mises Tutilisation des frequences, 
mais ne suppose pas Texistenc© nicessaire de leur limite; pour lui, la 
valeur de la probabilite doit etre interpretie comme “la frequence idia- 
lisie de Tivinement dans de longues siries d’ipreuves ripities/’ C’est 
une difinition qui nous semble s© rapprocher de cell© priconisie par M. 
Gini et qui parait s’accorder plus encore avec celle que nous avons pro- 
posie et oh la probabiliti d’un ivinement E dans une catigorie d’ipreu- 
ves (ou une “population”) C, est une grandeur physique attachie au 
systime grandeur dont une ivaluation expirimental© est fournie 

par la friquence de E dans un grand nombre d’ipreuves de C, 

On trouvera une discussion approfondie de oes diffirentes difinitions 
dans notr© ricent article “Les difinitions courantes de la probabiliti.”^^ 
Nous y avons en particulier ripondu d’avanc© h une objection faite ans 
sa riponse par M. von Mises centre la difinition de Laplace “II n’y a 
rien, dit-il, qui puisse etre considiri comme des cas igalement vraisem- 
blables quand un di irrigulier est jeti. Par consiquent cette interpre¬ 
tation d© Laplace doit etre rejetie.” Dans notre article citi, nous fai- 
sons observer k la page 155, que la meme difficulti s© prisenterait dans 
la thiorie des aires si Ton s© contentait d© difinir Taire par dicomposition 
en carris igaux. On complitera done la difinition de Laplace comme 
on complete la difinition pricident© d© Taire, on conviendra que: 
“Quand un ivinement E entrain© un ivinement F, la probabiliti de 

»• C’est dajis le mdme esprit que M. Wilson, que nous avons eonsacr^ notre 
Premier Oahier de **Le 9 ons de Statistique Math^matique” k un expos6 abr6g6 de 
caloul des probabilit^s, expos6 dont un second tirage, sous forme polycopide vient 
. de paraltre. 

Rtvw Phtlosopkique, 1946, T. OXXXVI, pp. 129-169. 
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F est par definition an moins ^gale k celle de jB.” Nous prefcrons cepen- 
dant I’interpretation de la probabilite par les frequences et nous avons 
repondus (pp. 149-154 de notre article) k certaines objections qu’elle 
a rencontr6es. 

Enfin, en ce qui concerne le degre de croyance, nous avons pose cette 
question: comment pourrais-je me rendre compte si le degre de 
croyance que j’attribue k un evenement se revfele un bon guide de mes 
actions? Comme il sera certainement un mauvais guide dans quel- 
ques cas—rev6nement isoie defiant les predictions,—^je n’aurai d’autre 
resource que de m’assurer s’il y a eu dans le passe une grande frequence 
de predictions justes, c’est-4-dire que j’aurai recours k la notion de fre¬ 
quence que je voulais eviter. D’autre part’ d’aprfes M. Neyman, “Tinter- 
pretation de la valeur de la probabilite comme une measure de ‘Tinten- 
site de la croyance’ appliquee aux evenements actuels est k la fois mys¬ 
tique et nuageuse. Si quelqu’un dit que la probabilite que la vie existe 
sur la planfete Mars est egale k, disons 0.357 et que ce nombre represente 
I’intensite de sa croyance, je puis seulement dire que je ne le comprends 
pas.” 

Mais ce n’est pas ici le lieu d’entrer dans les details de la discussion. 
II nous suffit d’avoir rappele combien les mathematiciens et statisticiens 
divergent dans leurs interpretations de la probabilite. Or, dit M. von 
Mises: ‘‘Difficultes, malentendus, et confusions sur le problfeme de 
I’estimation se sent presentees et doivent necessairement se presenter 
tant que le terine probabilite est employe d’une fa 9 on vague et n’est 
pas fonde sur une definition precise.” 

De son fcote, M Fortet ecrit: “La theorie de I’estimation des para- 
mfetres, et plus generalement de la recherche des causes et des tests d’hy- 
pothfeses, est essentiellement conditonnee par I’opinion que I’on a sur 
la nature de la probabilite et sur ce qu’il faut entendre par ‘element 
aleatoire.” D’ailleurs, ces deux auteurs n’adoptent pas la meme de¬ 
finition de la probabilite. 

On voit ici, se renouveler sur un domaine tout k fait distinct des pre¬ 
cedents, les divergences que nousavons signaiees au d6but de ce rapport 
et qui' montrent combien la question enlitige est epineuse. 

Cependant, nous pla 5 ant sur le terrain des faits, constatons d’une part, 
que la technique exige qu’on adopte une solution, bonne ou mauvaise, 
du problbme de I’estimation statistique des paramfetres, d’autre part 
que les r6sultats foumis par les diverses m^thodes envisagees, meme 
quand ils ne coincident pas pxactement, sont g6n6ralement acceptables 
dans la pratique. Bien souvent dans de nombreux domines, des regies 
empiriques (comme I’emploi des coefficients de s6curite des ing^nieurs) 
ont permis de resoudre les problfemes pratiques pos6s, sans avoir une 
justification suffisante. L’adoption dans ces domaines, d’une nouvelle 
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r&gle, mieux justifi^e, quand elle a eu lieu, n’a pas eu pour efifet de re 
soudre un probl^me d6jlk* pratiquement resolu, mais seulement d’en 
am61iorer la solution. 

Le but modeste mais cependant extremement utile de cette enquete 
nous parait ^tre de donner une interpr<Station plus exacte des m^thodes 
d’estimation des param^tres et nous esp^rons que ce rapport aura fait 
faire un pas de plus vers ce but. 

Annexe 

B^ponses a l’ENQUETB 

Question posee, Un 6venement E a ete observe r fois dans n epreuves. 
Sachant (ou admettant) que E y avait une probability constaAte (mais 
inconnue) p, que peut on dire de la valeur inconnue de p, connaissant 
seulement n et le nombre r de rypetitions de E (ou sa frequence / = 
rM) 

A-t-on des objections (et lesquelles?) k faire centre Tune ou Tautre 
des mythodes connues qui donnent une ryponse k cette question? 

Pour simplifier k la fois la ryponse et la comparaison des ryponses, 
on ne demande d*e.xaminer que le cas oti n = 1 et r = 1. 

Rkponses. 

1. JK. mn Mises (Boston, U.S.A.) 

2. R. Fortet (Caen, France) 

3. Bruno de Finetti (Trieste) 

4. Henri Eyraud (Lyon, France) 

5. Maurice Dumas (Paris, France) 

6. Jf. S. Bartlett (Cambridge, England) 

7. J. Neyman (Berkeley, California, U.S.A.) 

8. Georges Darmois (Paris, France) 

9. L, H. C, Tippett (Manchester, England) 

10. Maurice Kendall (London, England) 

11. R. C, Geary (Dublin, Ireland) 

12. Lucien Feraud (Geneva, Suisse) 

13. Oskar Anderson (Kiel, Germany) 

14. J. B, D. Derksen (The Hague, Netherlands; at present Statisti¬ 

cal OflSice, United Nations) 

16. Charles Jordan (Budapest, Hungary) 

16. Harold Cramer (Stockholm, Sweden) 

1. B. von Mises 
THE ESTIMATION PROBLEM 

It is most gratifying that the International Statistical Institute decided 
to initiate a discussion of the estimation problem and thus to bring into 



MAtTBtOB 


the open an issue that has become highly controversial during the past 
decades. Difficulties, misunderstandings, and equivocations of the kind 
here encountered are bound to arise as long as the term Probability is 
used in a loose way and not based on a precise definition. On the other 
hand, all the confusion disappears if a clear probablity concept is applied. 
As a matter of fact, it was this type of difficulties as they arise in con¬ 
nection with the Bayes problem, estimation, small samples, etc., that 
prompted the present writer to develop, about twenty-five years ago, 
the fundamentals of a consistent system of probability calculus, gener¬ 
ally known today as the frequency theory of probability. 

It is not feasible to start the comment on the estimation problem 
with a statement that these comments are or are not based on “Bayes 
formula.’’ First of all, just what is meant by “Bayes formula” is to 
a certain extent controversial. Besides, the strictly negative answer 
to the particular question (n = 1, r = 1) submitted for discussion by the 
Institute has certainly nothing to do with Bayes formula or any 
formula at all. 

In the following a brief discussion of the problem is given. A sum¬ 
mary of the results is added at the end. 

1. The basic problem 

The problem proposed for discussion by M. Fr6chet has to be re¬ 
stated in the following way if the term Probability is replaced by its 
definition. 

Given the description of a repeatable experiment that can lead to 
two different results, only, say, zero and one (the result one may also 
be called occurrence of the “event”). It is supposed that the experi¬ 
ment can be repeated endlessly and that in this sequence the frequency 
of events approaches a certain limiting value p (which is called the event 
probability).^ Now, it is known that n experiments have been carried 
out and that r times the event has occurred. The question is: What 
can be inferred from the data n and r upon the value of p, that is, upon 
the frequency of the event in the long run? In particular, the answer 
is requested in the case n = 1, r = 1. 

Were the so-called classical definition of probability used, the ques¬ 
tion would read: What can be inferred from the knowledge of n and r 
upon the ratio of the number of favorable cases to the number of all 
equally likely cases? But, there is no such thing as equally likely cases 

‘ In the present text the terms Probability and Chance are used indistinctly 
for the frequency limit in an infinite sequence of trials. For a more elaborate study 
of the problem it is advisable to restrict the use of one term (Probability) to those 
0ases where the randomness, condition is fulfilled. ^ 

49 
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when a biased die is tossed, etc. This interpretation must, therefore, 
be discarded. 

On the other hand, the more elaborate scheme of frequency theory 
♦ that is known today under the heading Probability as a Measure of 
Set, could be applied. The conclusions, however, would be essentially 
the same as those presented below. 

2. Answer in the case n = 1, r = 1. 

The answer is simple, short, and unequivocal in the case n = 1, r = 1, 
that is when one experiment has been performed and this has led to the 
event. The answer reads: nothing. No inference can be made from 
the outcome of one experiment or, as will be seen later, from any small 
number of experiments. 

Let, e.p., the experiment consist of tossing a die and observing whe¬ 
ther, or not six spot appears. If it is known that in one trial the event 
occurred, it can be that the die is unbiased, ?‘.e., p = 1/6; it can also be that 
that three of the six faces of the die are marked “6'*; it can be that the 
die is loaded in some way so as to make the six spot appear less or more 
frequently in the long run than with p = 1/6; it can even be that, six will 
appear in the long run so rarely that the limiting frequency is zero. No 
icidation whatsoever is given by the outcome of the single experiment 
as to which one of these cases (or which other one) is actually present. 
The same situation prevails if r and n are any small numbers. 

If the experiment consists of extracting seven times a letter from 
a box containing the twenty-five letters of the French alphabet with 
the appearance of the word MIRACLE as the event, the same conclu¬ 
sions hold. If in one trial the event actually occurred, it can be that 
the method used in extracting the letters favors some combinatiolis and 
it can also be that no such bias is present, that is, that in a sufficiently 
long sequence of trials each combination of 7 letters would appear with 
the same frequency p = 4 x 10"^®. In the latter case the method of 
extraction would be said- to be unbiased. But, whether in the case 
which we caU “unbiased” the event probability is 1/6 or 10'^® is en¬ 
tirely immaterial. It makes no sense to say that an event whose pro¬ 
bability is 10"^® is “practically impossible.” If his way of talking is 
consistently used one would have to say that no combination of 7 let¬ 
ters is “practically possible.” The meaning of p = 10~^®is nothing 
more and nothing less than; In a sufficiently extended sequence the 
event will appear with this frequency; no additional or modifying state¬ 
ment is justifiable. 

The description of the experiment can also be modified so as to read: 
Extract 7 letters and look up whether or not the outcome appears 
among the entries in the Dictjionnaire de TAcademie Francaise. Here, 
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the p-value in the case which we call ‘‘unbiased” will be somewhere 
between 4 x 10*^® and 1/6. The conclusions remain unchanged. 

3. The nature of the failure 

Why is the answer to the above question totally in the negative? 
Why is it that no inference can be made from n = 1, r = 1 upon the un¬ 
known value of p? Answer; Because the data are incomplete. 

If a surveyor has measured the length of a basis AB and the angle 
a between the basis and the straight line AC towards some point C, he 
can make no inference upon the distance AC. Everybody familiar 
with Euclidian geometry knows that these data are incomplete and that, 
e.g,y the angle ^ between the basis and BC need also be known. 

It will be shown in the following that, in the case of the estimation 
problem, a certain kind of inference can be made if w is a large number. 
To give here a geometric analogy, consider this problem: A convex 
polygon of n sides is inscribed to a circle of area 1; how large is the area 
of the polygon? It is well known that no inference upon this area can 
be made (except that it lies in certain limits, as p lies in the interval 
0 to 1), since the data are incomplete and something more, e.gr., (n—1) 
angles of the polygon, have to be given. However, if n is a very large 
number one will be inclined to say that the area is approximately 1 or that 
it approaches unity when n increases indefinitely. In fact, this is cor¬ 
rect if an assumption of qualitative character is introduced, for instance, 
the assumption that while n increases the ratio of the greatest to the 
smallest sidelength remains bounded (the bound need not be known). 
Thus the situation is such, that for small n not even an approximate 
answer is possible without additional numerical data, while for large 
n an asymptotic approximation can be found provided some assump¬ 
tion about the circumstances of increasing n is used. 

This geometric example shows how we have to proceed if we aim 
at an (approximate) answer to the estimation^ problem for large n. The 
first step must be to complete the data so that they allow a definite 
answer for any n, large or small. Secondly, we have to introduce a 
plausible assumption concerning the conditions under which n increases 
towards infinity. Third, it has to be shown that with increasing n the 
additional data become less and less influential so that the quantity 
in question reaches a definite limit for n — oo. The result is, of course, 
valid only insofar as the assumption used is accepted. 

4. Complete data 

If, in the case of a die, we ask for an estimate of the event probabi¬ 
lity p, we obviously suppose that there exists a multitude of dice with 
different jp-values and that one of those dice has been chosen for the 
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experiments. Furthermore, asking for an estimate of p does not mean 
that we think to find the actual p-value of the chosen die, since it is like¬ 
wise obvious that any couple, r, w, however large n may be, can occa¬ 
sionally be obtained with a die of any value p. All estimation theo¬ 
ries agree in this respect. They try to make statements only about 
the chance or probability that the p-value of the die used in the ex¬ 
periments falls in certain limits. 

If we substitute here, as it was done before, for the term Chance its 
definition, the experiments in* the sequence to be considered for the 
definition include each two steps. The first step consists of the selec¬ 
tion of a die from a given multitude of dice, the second of casting this 
die n times. In the latter sequence we have the well known function 

(1) qn{p) = (?)p"(l~l>r' 

for the probability of obtaining r events in n trials, p being the event 
probability in each of them. If then, in the sequence of first steps, the 
chance of selecting a die with a p-value between p^ and pg is given in 
the form 

Pi 

(2) j f(p)d^ 

Pi 

we have all data required for computing the probability of p as inferred 
from he n trials. Quite elementary and incontestable rules of probability 
calculus supply for the probability of p falling in the interval from p^ 
to Pa the expression 

Pa 

f f{p)Qn{p)dp 

( 3 ) PalPl, Pi) = - 

’ I f(p)9xi{p)dp 
0 

This is sometines called Bayes’ formula. (In fact, Bayes did not 
include the decisive factor, /, neither did Laplace). The correctness 
of (3) under the assumptions made in the first lines of this paragraph 
is not contested. Those statisticians who decline to use this “Bayes 
Formula” do it for various reasons: a) because/is unknown whichmakes 
the formula useless; or b) since such a function / does not exist or c) 
because p is “not a variable but an unknown constant” which means 
that obivously ho /(p) can be considered. We shall deal with the ob¬ 
jections b) and c) later. But it has been our task so far to find only 
that complete set of data which would answer the question for any r and 
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n. We learn that what is needed in addition to r and n is the function 
that is, a definite knowledge independent of, or prior to, the 
tossings and concerning the structure of the set of dice from which the 
actual die has been chosen. 

5. Case of large n 

In order to obtain an approximation for (p^, p^ in the case of large 
n we study the limit of pn for ^ tending towards infinity. A limiting 
function can be found if, with increasing n the ratio rjn approaches 
a certain value a of the open interval 0 to 1. Making the following 
assumptions for/: a) f(p) is bounded in the interval 0 to 1; b) / is positive 
and continuous at the point p = a, we can prove 


(4) 


lim ^ (Pii P 2 ) _ Y 
n= 00 ^ 2 ) 


where ^ is the Gauss integral 

1 f ^2 2 

(5) u^) = du 

Vn J 


and the u and p are related by 


( 6 ) 




The convergence in (4) is uniform for all and in any interval —U to U. 
The unknown function f{p) does not appear in (4) to (6); no value of 
F need be given .2 

If the denominator in (4), in the case of large w, is considered an approxi¬ 
mation for the numerator we find for example: If an event occurred in 
half of all experiments, the probability of p falling in the interval 0.49 
to 0.51 is about 0.47 in the case n = 1000, and about 0.95 in the case 
n = 10,000. The degree of approximation (the strength of convergence) 
depends, of course, on the upper and lower bounds of / and, above all, 
^n the variability of / in the vicinity of ^ = a. In many cases some 
general knowledge concerning /(^;) is available which allows us to derive 
exact inequalities for PrfPxy p^-^ But the main result is this: While, 
from d small number of tossings with one die, nothing can he concluded 


* This theorem was first proved by R. v. Misos, Mathem, Zeitschrift, 4 (1919) 
p. 83. The conditions for f{p) as given in the text can be reduced to weaker ones. 
See also R. v. Mises, Monatahefie fur Mathem* und Physik, 43 (1936), p. 118. 

■ Such cases are discussed by R. v. Mises, Annala of Math, Statiatiea, 13 (1942), 

pp. 166-166. 
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withxid knowing 'precisely the structure of the set from which this die was 
chosen, the inference becomes more and more independent of this additional 
knowledge as n increases, 

6. Small sample theories 

In the last few decades some statisticians developed new methods 
of estimation with the outspoken aim to derive substantial conclusions 
from a small number of observations. A detailed analysis of these 
methods cannot be given here, but two significant examples may be 
quoted. 

In a comprehensive survey of Small Sample Theory (1931), Paul R. 
Rider discusses^ a sequence of 10 experiments performed on some sleep¬ 
ing drug. The results (observed prolongation of the normal sleep length) 
lay between —1.6 and 3:7, four were negative, one zero, and five posi- 
tive, the average was 0.75 and the standard deviation 1.70. From 
these observations it is concluded, using the so-called Student distri¬ 
bution: The probability is 0.888 that the drug is effective, i.e., that 
in the long run the average observed value will be positive. The same 
method‘applies also to the case n = 2 and would then lead, e.g,, to the 
statement: If one observation is 0.63 and another one 0.67 we have, 
without knowing anything else about the nature of the drug, a probabi¬ 
lity of 0.90 that the drug is effective, or in other words: out of 1000 drugs 
of which nothing else is known than that they gave in one couple of 
trials those results, about 900 will have in the long run a positive average. 
In the opinion of the present writer nothing at all can be inferred from 
2 observations. In fact, Rider’s conclusion is based on a misin^rpre- 
tation of the Student distribution. 

In a paper of 1931, R. A. Fisher discussed at length the exploration 
of a correlation coefficient from the observations on a small sample.® 
If n == 4 pairs of observations give a value r = 0.99, he concludes, there 
is a probability of 0.80 that the long run correlation coefficient p will 
be not less than 0.765. Again this conclusion, so contrary to common 
sense, is based on an unwarranted substitution of one probability for 
a different one. It would be extremely dangerous if anybody who has 
to make a responsible decision about the correlation of two variables^ 
were to rely in any way on 4 pairs of observations. 

As mentioned above, the usual objection against the classical theory 
of estimation is that the unknown event proba.bility p (or any quantity 
derived from it) cannot be considered as the independent variable of 
a frequency distribution f(p). This may be true in many problems, 

* Paul R. Rider, Annals of Mathem,, 31 (1930), p. 677. 

» R. A. Fisher, Proceedings Cambridge Philos, Society, 26 (1930), p. .532. 
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but it is hard to see what in such cases estimation means. If it is not 
possible to figure that the object of experimentation can be varied so 
as to admit various j>-values, how can one speak of the chance of p 
falling in some interval? And, if statements are made that include 
other terms than chance or probability, like likelihood, fiducial pro¬ 
bability, level of confidence or of significance, the first thing to do would 
be to give clear operational definitions for these terms. This has so 
far not been done. * 


7. Summary 

If an inference has to be made from the outcome of n experiments 
upon the value of the unknown event probability (or any quantity de¬ 
rived from it) sufficient additional information about the set from which 
the object of experimentation has been chosen is indispensable. For 
small w, the complete frequency distribution f(p) in this set must neces¬ 
sarily be known. As n increases the influence of this additional 
knowledge becomes less and less pronounced. For large w, approxi¬ 
mative statements are possible, based, as to /, on general, qualitative 
assumptions only. ‘‘Small Sample Theories'* which lead to substantial 
inference for all w, down to n = 2 or 3, etc., without using any informa¬ 
tion prior to the experiments are contrary to common sense and based 
on a misinterpretation of formulae of probability calculus. 


Resume 

Pour faire une conclusion sur la probabilite p d'un evenement qui 
s’est r6alise r-fois dans n epreuves (ou sur une quantite d6riv6e de p)^ 
il est indispensable de se servir d’une information additionelle suflSsante, 
prealable aux epreuves et concernant la structure de Tensemble d’objets 
duquel I’objet employ^ dans les epreuves fut choisi. Dans le cas de 
n petit il faut connaitre complfetement la fonction de distribution f(p) 
dans le dit ensemble. Lorsque n augmente, Tinfluence de cette infor¬ 
mation additionnelle devient de moins en moins prononcee. Pour n 
suffisamment grand, on pent rediger des enonces de nature approxima¬ 
tive, bases, quant 4/, sur de seules hypotheses generales et qualitatives. 
Les “Theories d'6preuves en petit nombre*’(/SmaZi Sample Theories) 
qui foumissent des conclusions substantielles dans le cas de tout w-, meme 
n = 2, 3, etc., sans avoir recours k une information prealable aux 
epreuves, sont centre le bon sens et se fondent sur une interpretation 
fautive des formules du calcul des probabilites. 
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2. R. P o r t e t 

REPONSE BASSE SUR LA FORMULE DE BAYES 

1. Bases d^une metfiode rcUionnellement satisfaisante 

La th6orie de restimation des paramfetres, et plus g6n4ralement de 
la recherche des causes et des tests d^hypoth&ses, est essentiellement 
condition6e par ropinion que Ton a sur la nature de la probability et 
sur ce qu’il faut erttendre par element aleatoire.*’ 

Probabilite et elements aleatoires: En considerant que tout yi6ment 
aiyatoire peut etre ramen^ k un yv^nement aiyatoire, je simplifierai 
le langage en ne parlalit que d’yvynements. 

Je me range (actuellement) k peu prys k Topinion de Keynes, considyrant 
que la probability d’un yvynement est une rysultante du corps de renseigne- 
ments supposy possydy relativement a cet evynement: cette fa 9 on de 
voir me parait la plus proche du processus mental de “Thomme de la 
rue” lorsqu’il conjecture; elle ychappe k des objections classiques si Ton 
remarque qu’on peut inclure dans le corps de reseignements des rysultats 
d’observations empiriques; s’il ytait prouvy (mais je ne crois pas ce point 
bien ydairci) que d’un corps de renseignements donnys resulte une 
probability bien dyterminye, toujours la meme quel que soit Tobserva- 
teur qui raisonne (sous ryserve qu’il raisonne juste), cette probability 
n’aurait rien de subjectif, elle serait purement rationnelle; elle ne serait 
pas non plus objective dans le sens des thyories qui partent de la notion 
de fryquence empirique. 

II est important de noter que cette probabilite rCest pas forcement ex- 
primable par un nomhre, il me semble qu’elle n’est assujettie dans le 
plus gynyral qn'k d’yventuelles relations d'ordre (> ou <), et il y a done 
une axiomatique k dygager, plus large que celle de KolmogorofF qu’elle 
doit inclure. G. Deschamps a fait dans cet ordre d’idyes quelques 
pas intyressants.® 

Un yiyment aiyatoire n’a done pas forcyment une probability numyri- 
quement prycisye, et les objections contre la methode de Bayes fondees 
sur le fait que dans bien des cos il est impossible de preciser numeriquement 
la hi a priori tombent, sous ryserve de formuler la mythode de Bayes 
dans le cadre la nouvelle axiomatique; je montrerai plus loin comment 
on pourrait opyrer. 

. Sur une objection classique: On dit souvent (je prends ici le probiyme 
pryeis qui est Tobjet de Tenquete) que p n’est pas une variable aiya- 
toiry, mais une constants bien dyterminee objectivement, simplement 
inoonnue de Tobservateur; cette fa 9 on a de voir me parait insoutenable; 
si j’envisage aujourd’hui 28 Janvier 1947, le rysultat du ISi^me coup de 


f Son travail n*est pas publiy. 
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roulette qui se jouera le 15 Juillet 1947 k Monte-Carlo, on sera bien 
d’accprd pour le consid6rer comme al6atoire, s’agisant d’un coup non 
encore jou6; si je pense k ce m5me r6sultat le 20 Juillet 1947, sans 
avoir eu entre le 15 et le 20 aucun renseignement siir ce resultat, iln*y a 
rien de change pour moi: cependent on nie demanderait k ce moment 
de modifier mon point de vue, parce que, le coup ayant ete dej4 jou6, 
son resultat n’est plus al^atoire, mais au contraire bien determine, 
seulement inconnu de moi. 

II est clair que, du point de vue Keynes adopte, p doit etre consider6r6 
comme al6atoire. 

Extension de la methode de Bayes*. Si p a une density a priori bien 
d6finie /(p), sa density a posteriori <p{p) est: 


0 ) 


,(,) - — 

I f(u)udu 
^ 0 


Mais que peut-on faire si p n’a pas une densite a priori num^ri- 
quement pr^cisable ? Je crois pouvoir montrer comment on pourrait 
proc^der de la fa 9 on suivante: 

Supposons que F(u) = Prob. a priori que p<u n'ait pas de valeur 
num4riquement pr6cisable, mais qu’on puisse assigner 2 nombres positifs 
I et L (0 <, I < L) tels que: 

l{u' — w) < F(u') — F(u) < L{u'—u) u* u 

ce qui traduit des propriet6s qualitatives assez simples de la loi a priori 

de p) on peut k peu pr^s traduire cela en disant que / (p) == est 

dp 

impr^cis^e dans la classe C des densit6s telles que: I ^ f(p) ^ L. 

Soit alors C" la classe des fonctions if>(p) definies par (1) lorsque 
f(p) varie dans C: on pourra considerer comme vraies, pour la loi a 
posteriori de p, celles des proprietes de v>(p), qui sont communes h toutes 
les fonctions de la classe C'. 

Pour ne pas allonger cette reponse, je ne pousse pas I’id^e prec^dente 
jusqu’4 ses consequences num6riques, je pense que ce qui pr6cMe suffit 
k le d^finir. 

Evidemment, pour etre complfetement mise sur pied, cette methode 
exigerait quelques travaux, les uns philosophiques, d’autres sur Taxioma- 
tique, etc. Mais pour le moment, je n’ai d’espoir qu’en elle pour r^soudre 
les difficultes de principe que soulfevent les probabilites des causes. 


2. . Remarques sur les autres mithodes couramment utilisees 

Les m6thodes qui pr6tendent ne pas s’appuyer sur Bayes sont obligees 
de se fonder sur un principe plus ou moins arbitraire, qui constitue un 

50 
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postulat nouveau: je critique Fintroduction, k mon sens inutile, d’ull 
nouveau postulat. 

Mais on peut montrer que, toutefois sous des conditons, mais tr^s 
gSnSrales, ces poatulats peuvent itre justifies par Vapplication de la methode 
de BayeSy mais seulement asymptotiquement, c’est-lt-dire pour n grand; 
dans le cas de petits 4chantillons, la precision num6rique de ces m6thodes 
est certainement assez illusoire. 

A propos des probahilites fiduciaires: M. von Mises a fait justement 
observer que, 4tant donn6e uqe rfegle d’estimation, ce qui importe est 
de connaitre la probability d’erreur qu’elle comporte une fois Vexperience 
faite, c’est-4-dire a posteriori, et revaluation d’une telle probability d’er- 
reur a posteriori exige, en principe, le recours k la mythode de Bayes. 

Toutefois, il faut tenir compte d’une remarque de Kolmogoroff dis- 
tinguant deux cas: 

a) Si celui qui dyfinit la rfegle d’estimation doit opyrer lui-meme, 
et n’est restreint par aucune restriction de temps ou d’argetn, etc., il 
dysirera tirer le maximum de ses rysultats, le point de vue von Mises 
devra jouer; 

b) Si celui qui dyfinit la rfegle d’estimation la dyfinit k I’usage d’exe- 
cutants auxquels on ne peut demander de faire des calculs compliques 
(cas de celui qui rydige un rfeglement d’artillerie oti il doit dyfinir une 
rfegle pour le ryglage des tirs), il est logique qu’il envisage seulement 
la probability d’erreur a priori; or celle-ci, si elle exige en principe I’in- 
tervention de la loi a priori, peut souvent etre yvaluye sans sa connai- 
sance:^ le point de vue fiduciaire prend alors, et en toute rigueur, tout 
son intyryt. 

3. B. de F.i n e 11 i 

1. REPONSE BASSE SUR LA FORMULE DE BAYES 

(1) En efiFet le probl^me et les mythodes n’ont de sens qu’en s’appu- 
yant sur le raisonnement de Bayes, meme s’il est sous entendu, dyguisy, 
refusy; 

(2) chercher une justification ‘‘sans recours k la formule de Bayes” 
c’est comme vouloir conclure de quel coty penchera une balance du 
fait que I’un des poids est “petit” en grandeur absolue (4) (au lieu que 
“petit” par rapport k I’autre (6)); 

(3) il n’y a rien de frappant si un ‘yvynement trys peu probable (6) 
(que ce soit le mot MIRACLE ou le mot CDATIPS) se ryalise, et Ton 
ne peut done du fait de sa ryalisation conclure que I’yvynement *‘avait 
une probability moins petite”(10); 

» Voir I’exemple envisagy par M. Frychet dans sa note k Portugaliae Mathe- 
xnatica, 1946, pp. 137-141. 
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(4) de mfime il n’y a aucune raison, de ce fait, de soup 9 onner que 
le tirage ayant donn6 r^sultat quelconque (MIRACLE ou CDATIPS) 
etait truqu6 (ou, en general, influenc6e par une cause A d4termin6e); 

(6) le soup 9 on de trucage ou Fintervention de la dit cause A est 
ju8tifi6 non-de ce fait que le r^sultat v6rifi6 etait “trts peu probable” 
(fait identique pour MIRACLE et pour CDATIPS); mais par 
comparaison avec la probability qu’un trucage ait yty ytabli dans le but 
de r6aliser certains r^sultats (probability grande pour MIRACLE et 
petite pour CDATIPS); 

(6) par ailleurs, la “probability du rysultat vyrifiy” n’est pas une 
notion dyfinie (objection de M. Dumas: le “rysultat,” est-ce le mot 
“MIRACLE” ou les faits “mot fran 9 ais,” “mot d’une langue connue,” 
“combinaison pronon 9 able,” etc.?); par consyquence les procydys “sans 
Bayes” ne sont pas seulement non justifiys mais non susceptibles 
d’application univoque (au contraire: elle est totalement indyterminye); 

(7) cette difficulty s’yvanouit en adoptant le raisonnement de Bayes 
oil interviennent les rapports entre les probabilitys (p. ex. probability 
truquye et probability au hasard de “mot fran 9 ais” oudu mot “MIRACLE; 
le rapport ne change pas si tout mot fran 9 ais a la meme probability 
truquye; dans la supposition contraire le rapport pour “MIRACLE” 
donne Fyvaluation correcte qui tient compte aussi des raisons particu- 
Uyres qu'on a de s’attendre un trucage destiny a produire prycisement 
ce mot). 

II. JusquHci je croia que le point de vue expose coincide avec le point 
de vue claasique) la conception subjective^* qui repond h lafaqonde penser 
qui m*est propre ne modijie nullement ces conclusions mais les rend .beaucoup 
plus nettea en adoptant les premisses plus radicaha suivantes: 

(8) la probability d’un evynement est la mesure du degry de con- 
fiance d’un sujet donny h Fygard de son arrivye; 

(9) elle n’est done dyfinie qu’avec ryference ^ Fopinion d’un individu 
qui I’yvalue (ou k Fopinion moyenne d’un group d’individus) comme 
la valeur d’une marchandise, qui serait une notion dypourvue de sens 
en considyrant des objets dont personne connait Fexisterce; 

(10) Fyvaluation d’une probability ne constitue pas une fait dont 
on peut dire s’il est “vrai” ou “faux”’ bien une opinion; 

(11) la notion de “probability inconnue** n’a pas de signification, 
la probability n’existant qu’en tant que et dhs Finstant oh elle a yty yva- 
luye par quelqu’un; 

(12) par consyquent on ne peut pasx parter de la probability que 
la probability d’un yvynement E ait des valeurs donnyes (probabilitys 
de 2® ordre, etc.); 
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(13) revaluation d’une probabilite concerne toujours une epreuve 
bien determinee, consideree isoiement; que plusieurs 6preuves soient 
appeiees ‘‘epreuves d^un mSme evenement** ou non ce n’est qu’une 
commodite de langage denude de signification intrinseque et d’interSt 
pour la th6orie des probabilites (je pr^ftre la terminologie: evenement 
= epreuve; epreuves d’un mfime phenomene au lieu que “d’un m6me 
6venement*’).. 

III. En void hs conaiquencea pour la poaition de prohllme conaidere: 

(14) on n’y pent pas parlor de probabilit6 “inconnue,** et on ne peut 
interpreter I’influence du resultat des epreuves successives observees 
comme une correction progressive dans revaluation de la memo proba- 
bilite inconnue; 

(15) au contraire, la probabilite non conditionnelle de chaque epre- 
uve et les probabilites conditionnelles (subordonnees aux divers resultats 
des epreuves precedentes) sont autant de grandeurs distinctes evaluees 
(ou de moins evaluables) avant toute experience; refiFet de robservation, 
c’est non de corriger revaluation d’une memo grandeur mais de choisir 
parmi cet ensemble de grandeurs domiees d’avance celle qui correspond 
k retat de connaissance atteint; 

(16) les difficultes provenant de la distinction entre “probabilite** 
et “vraisemblance** disparaissent, car selon (8), (13) il s*agit toujours 
de “probabilites** entendues dans le sens qui pour ceux qui feraient la 
dite distinction, corresponde plut6t au mot “vraisemblance**; 

(17) apr^s avoir ainsi eiiminees les difiicultes que I’on rencontre 
d*apres les autres conceptions et qui, selon la presente, apparaissent 
illusoires, on recontre par contre des difficultes nouvelles dans la t&che 
de poser le probl^me en se passant des notions dedarees illusoires et 
en gardant des exigences particulibrement rigides de rigueur logique 
qui en decoulent (la chose la plus difficile c*est cependant de faire pene* 
trer I’esprit de la position du problbme h ceux qui sont accoutumes k le 
voir aautrement); 

(18) il s*agit avant tout de definir ceux que I’on appellerait “evene- 

ments independants k probabilite constante mais inconnue*’; on y a 
reussi par la definition de “evenements equivaleiits” (tels que, de toute 
fa 9 on que I’on en choisisse un nombre n quelconque, la probabilite que 
tous le n evenements se verifient a toujours une meme valeur ne 

dependant que de n; il en resulte qu’il 'en est de la probabilite que 

r parmi eux se verifient et n-r non; en particuli^r la probabilite dQ chaque 
evenement a toujours la mSme valeur tai); 

(19) de cette definition il decoule que la loi de probabilite Fn (x) = 

2r<iix»f^de la frequence rjn, converge vers une loi-limite F(x) 
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lorsque n oo, et que toute probability peut s’cxprimer comrm si Ton 
admettait de dire “la probability inconnue, etc., est un nombre aiyatoire 
X suivant la loi F(xy' (c’est-li-dire: “ F{x) est la probability que cette 
probability inconnue X soit<ip”); p. ex. 

I (“) — xY’^dF{x)\ 

(20) il est lygitime d’associer k ce fait une interprytation concryte 
seulement s’il y a une grandeur X physiquement definissable qui coincide 
avec la valeur de la probability conditionnelle: p. ex. dans le cas d’une 
urne de composition inconnue RjN^ en supposant que, comme probabi¬ 
lity subordonnye k la composition RjV, on prenne la valeur RjN, la 
probability conditionnelle coincide avec la composition” (pourcentage 
des boules blanches) qui est une grandeur physique; 

(21) il faut cependant toujours distinguer entre la grandeur (fait 
objectif) et la probability (opinion subjective): meme dans Tex. (20), 
on n’est pas obligy k la dite yvaluation: pour des raisons particuliferes 
ou meme sans raisons dyterminees on aurait le droit de penser p. ex. 
que chaque boule blanche k probability double des noires et ainsi que 
la probability correspondant k la composition R/N serait non plus R/N 
mais 2RJ{2R+N—R) = 2R/(N+R); 

(22) la position de problime de (15) n’est pas liye a rhypothfese par- 
ticuKire qui caractyrise les “yvynements yquivalents” mais sa validity 
yty tout k fait generale; une condition plus large de T^yquivalence” 
est, p. ex., celle de T^yquivalence partielle.”® 

IV. EXEMPLES pour eclaircir quelques-unes de ces theses: 

(3), (6) Si les raisoimements “sans Bayes” k propos du tirage “MIRAC¬ 
LE” devaient ytre acceptys, il faudrait accepter de meme les sophismes 
de ces joueurs qui refusent un billet de loterie portant un numyro “spy- 
cial” (p. ex. 100,000 ou 123,456) car de Thypothyse que tout billet ait la 
meme probability ils dyduisent contradictoirement que celui-lk a une 
probability particulierement petite. 

(15) Au meme compte que la probability de gagner une loterie aprys 
que le billet donny a yty tiry, aprys qu’il a yty associy k un des concour- 
ants au grand-prix, aprys avoir assisty k la course qui va se conclure sous 
peu, ne sont pas des corrections successives de I’yvaluation initiale que 
ait yty “incorrectement” fondye sur le nombre des billets achetys, seul 
yiyment du jugement dont on pouvait disposer k cet instant. 

• Pour toutes ces questions voir; La pr^visian: aes lois logiqvLe-a, sea sources sub* 
jectivea (Inst. Henri Poincar6), Sur la condition iquivaler.ee partielle" (Actuality 
soientiBques et industrielles, 739). 



398 IKTBRNATIONAL STATISTICAL CONFBBENOES: I S I 

P 

(20) i^xexnple du oas contraire: le jeu de pile ou face aveo une pifece 
d’apparenoe irr^guliire. La loi de probability F{x) de la fr^quenoe sur 
un “nombre tris grand d’^preuves” n’est pas la loi de probability d’une 
grandeur physiquement dyfinissable coincidant (dans le sens de (20)) 
aveo la probability. On n*a pas le droit de dire que F{x*^)—F(x') est 
la probability que “Timperfection de la monnaie soit telle qu’elle lui 
donne probability oomprise entre et x'', car ne sont pas dyfinies les 
oirconstdnoes de fait qui oorrespondraient 4 telle yvaluation de proba¬ 
bility. 

4. H. E y r a u d 

BEPONSE BA8EE SUR LA FORMULE DE BAYES^ 

La solution dypend d’une fonction arbitraire, notamment la proba¬ 
bility a priori u{x) pour que la probability p inoonnue soit comprise entre 
zyro et a;. 

Si TJ(x) est alors la fonction cumulative de probability a posteriori, 
o’est-4-dire apr^s Tapparition de Fyvynement E dans une seule ypreuve, 
on a: 



Dans le cas le plus simple de probability a priori uniforme (absence 
de dominante) on a: 

u{x) — x 0 < » < 1 

U{x) = a;* 0 < a: < 1 

La probability dominante est = 1 
La probability moyenne est jp = 2/3 = 0.666 


L’ycart t 5 q)ique est 



0.235 


5. M. D u m a s 

SANS RECOURS A LA FORMULE DE BAYES 

D’aprys le rysultat une fois sur une, il n’y a aucune raison de supposer 
que 1 yvynement contraire de soit E\ peut se produire, 4 moins de 
faire ytat d’une connaissanoe qui ne figure pas dans rynoncy de la question. 

* CJ, H. Eyraud, Cowra de Probabilitia et Statiatiquea, 2e Mition, 1036, p, 17 (Ins- 
titu* de Science Financi^re et d’Assuranpes, University de Lyon). 
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Le bon sens impose done de consid6rer Farrivee de r6v6nement E comme 
une certitudey soit == 1; mais il indique par ailleurs que cette certitude 
n’est bas6e que sur un tr^s petit nombre d'6preuves et qu’il ne faut 
peut-etre pas lui accorder grande confiance. 

Pour avoir une id^e cette demifere, je propose ceci: Si une seconde 
6preuve 6tait faite, elle conduirait au total, soit k deux arrivees de E sur 
deux 6preuves, ce qui renforcerait la certitude; soit k une arrivee de E 
sur deux 6preuves. 

Done, la confiance k accorder k la certitude resultant de 1 fois sur 1, 
est au moins igale k celle qui r6sulterait de 1 fois sur 2. Or, par raison 
de sym6trie, d’aprfes 1 fois sur 2, le bon sens conduit k attribuer k toute 
valeur de p une probabilit6 61ementaire la meme dans tous les cas. Done, 
d’apr^s le seul resultat 1 fois sur 1, la confiance k accorder^ Feotimation 
p = 1, est It preciser ainsi: la probability int^grale de toute valeur de 
p est au plus egale k p. 

Remarque I: Eoctension de la regie 

a) La question pos6e se presente de fa 9 on quelque peu difierente 
si le resultat 1 fois sur une ^preuve est constate au cours d*une serie 
d’ensemble d’epreuves, si par example la question est la suivante: 

“On dispose de m populations k chacune desquelles correspond une 
valeur de p qui lui est propre et qui est inconnue. On convient de faire 
subir une epreuve k chacune de ses populations. On remarque j popu¬ 
lations ayant fait apparaitre Fev^nement E et m-j F^v^nement contraire 
de E. Que peut-on penser d’une population ayant fait apparaitre 

D’aprfes la r^gle Aw (M. Fr6chet, 1946) on a une probability de se trom- 
per au plus ygale It oi au cours des m affirmation suivantes: populations 
ayant donny E: pour chacune d’elles la valeur de p est dite comprise 
entre cd et 1; populations ayant donny yvynement contraire de E\ pour 
chacune d’elles la valeur de p est dite comprise entre 0 et 1—o>. 

Cela est certain, mais on peut aller plus loin. On peut affirmer que 
Fespyrance mathymatique du nombre des erreurs faites est au plus 
ygale Ik m<o dyfinissant par la condition que d’aprfes la loi binomiale de 
paramytre «, et appliquye It m tirages, la probability intygrale de 
est ygale Ik 1 —e, on peut affirmer avec la probability 1—e que le nombre 
total des erreurs faites est au plus ygal It On peut done affirmer a 

fortiori avec la probability l—e que sur les j populations ayant fait 
apparaitre Fyvynement E, il y en a au plus pour lesquelles Faffir- 
mation que p est compris entre et 1 est fausse. 

b) La quantity my^ peut etre quelconque par rapport k il se peu 
que Fon ait m^o) > j et dans ce cas on ne peut meme pas affirmer avec la 
probability l—e que parmi les j populations ayant donny Ey il y en a 
une seule dont le p soit effectivement compris entre « et 1. 
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Voici Texemple d’un cas 06 , s’il en 6 tait autrement. cela choquerait 
le bon sens: 

Soient m populations dont les p sont tous egaux ^ < w. Si n’est 

pas nul, il y aura cependant des populations qui h I’epreuve donneront 
E\ soit j ce nombre. L*esp 6 rance math 6 matique de ce nombre est mwi; 
si Ton d^finit par la condition que d’apr&s la loi binomiale de para- 
m^tre et se rapportant k m 6 preuves, la probabilite integrals de mgu), 
est 6 gale k 1 —e, on sait avec la probabilite l—c que le nombre J des 
6 preuves donnant E est infSrieur k Or d’aprfes les lois binomiales 

jconsid 6 r 6 es: m 2 <«>i < Done j < mico. 

c) Voici maintenant Texemple d"un cas oti Textension ci-dessus de 
la r^gle A<a est d’un grand int^ret pratique: lorsque Ton veut classer 
des lots d’objets en deux categories suivant le resultat d’une serie d’^p- 
reuves subie par chacuh d’eux, e’est sou vent pour mettre en service les 
lots d’une cat^gorie et pour rebuter les autres; et s’il faut ^viter de re- 
buter des lots qui auraient m 6 rite d’etre mis en service, I’essentiel est 
de ne pas mettre en service des lots qui meriteraient d’etre rebutes. On 
sait calculer gr&ce k I’extension susvisee et en fonction d’une probabilit 6 
e combien, au minimum, parmi les lots admis il y en a qui meritaient 
eflFectivement de I’etre. L’attention est opportunement attir^e sur le 
fait que ce nombre est fonction du nombre total des lots 6 prouv 6 s, qu’ils 
aient ou non 6 t 6 rebutes: cette notion ne nous semble pas avoir 6 te bien 
d 6 gag 6 e jusqu’^t present, mais maintenant elle nous parait s’imposer 
avec la force d une Evidence. 


Bemarque 2: Trop grande particularite de la question posee 

La question pos 6 e se rapporte k un cas trfes particulier et il se trouve 
pr 6 cis 6 ment que le bon sens conduit pour elle d; une solution plus com- 
plfete que dans n’importe quel autre cas; en effet sa solution met en cause 
le cas de I’arrivee de 1 fois sur 1 qui est un resultat sym 6 trique. 
Si par exemple la question posee avait 6 t 6 relative k 2 fois sur 2 , nous 
aurions ^t 6 amen 6 k envisager le cas 2 fois sur 3, cas qui attire Tatten- 
tion sur la valeur p = 2/3, mais qui ne permet pas de conclure relative- 
ment aux probabilit^s integrates de p. 

Je crois devoir rappeler ici un resultat donne par M. Bachelier et 
qu’admet le bon sens, k savoir que du seul fait que le resultat r fois sur 
ti epreuves a ete obtenu, et que d’une fa 9 on generate le resultat fois 
sur n 2 epreuves attire I’attention sur la valeur p = rg/wg, on est conduit 
k donner k I’arrivee de fois en n^ nouvelles epreuves la probabilite.* 

rill (n—1)1 (r+r^—1)1 (n—r+ni—r-i—l)! 

\ (ni—ri)l (r— 1)1 (n—r— 1)1 * (n+r^i—l)! 
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On saii que le raisonnement consiste k admettre que Texp^rience 
nouvelle est suivie 6preuve par epreuve et que pour chacune d’elles la 
probability de Tarrivye de ryv^nement E est ygale k la frequence cal- 
cuiye d’aprfes toutes les epreuves antyrieures. 


Remarque 3: Conditions moyennant lesquelles une methode 
d'estimation de p pent 6tre retenue 

Je pense qu’4 moins de faire plus ou moins explicitement une hypo- 
thyse, le bon sens, et par suite aussi le calcul, en prysence d’un rysultat 
r fois en n ypreuves, ne peut pas faire plus qu’attirer I’attention sur la 
valeur de p = rjn, et qu’en particulier il lui est impossible de pry- 
ciser quelle conhance on est en droit de reconnaitre k cette estimation. 
Je pensa done que tout raisonnement precisant cette confiance implique 
nycessairement une hypothyse, et il est de fait que parfois des hypo- 
thyses non faites explicitement ont pu etre dyceiyes (M. Frychet; 1943). 

Je ne m’oppose pas a ce qu’une hypothyse soit faite pour permettre 
de pryciser cette confiance, mais je pense que Ton peut exiger deux cho- 
ses: d’une part, que cette hypothese soit hien degagee et explicitement for-- 
mulee d'autre part, surtout que le developpement de cette hypothese ne 
conduise h aucune coTdradiction par rapport a ce qu'indique le bon sens. 

Dans ma ryponse basee sur la formule de Bayes, j’indique une hypo¬ 
thyse de probability, a priori qui satisfait k ees deux conditions. 
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REPONSE BASEE SUR LA FORMULE DE BAYES 

Toute ryponse basye sur la formule de Bayes ne peut faire intervenir 
une loi de probability a priori dyduite d’une connaissance antyrieure, 
puisqu’aucune telle connaissance n’est notye dans I’ynoncy de la ques¬ 
tion. Force est done de faire une hypothlse de probabilitys a priori. 
Je propose de retenir comme hypothyse de probabilitys a priori, la loi 
virtuelle dont la probability yiementaire est proportionnelle k dpfp(l--p), 
ou, plus succinctement, je propose Thypothyse dplp{l—p), et cela pour 
les raisons exposyes dans la remarque I. 
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Aveo rhypoth^ retenue, la r^ponse k la question pos^e est celle-oi; 
la probability yi6mentaire d’une valeur p est 

^ P{l—P) 

L’intAgrale du d^nominateur est infinie; de ce fait k toute valeur de 
p correspond une density de probabilite nulle, sauf lorsque p ^gale 1 
car toute cette valeur la density prend la forme ind6terminee 1/0 x oo ; 
comme la probability totale des valeurs de p est 1, c’est que cette form; 
indyterminye est ygale k 1. Finalement, la connaissance exclusivede 1 
fois sur 1 conduit k conclure k la certitude de Tarrivye de I’yvynement 
Ey comme le veut le bon sens (c/. notre reponse sans recours k la formule 
de Bayes). 

Eemarquons que le rysultat 1 fois sur 2 aurait conduit k 

et que par suite, les considyrations dyvyioppees dans notre reponse sans 
recours k la formule de Bayes ytant encore valables, rhypothfese 
dplp{l—p) conduit elle aussi k ceci; d’aprte le rysultat 1 fois sur 1, on 
doit admettre que la probability intygrale de toute valeur de p est au 
plus, ygale k p^, 

Remarque 1: Raisons en faveur de Vhypothese retenue 

a) L’hypothyse dplp(l—p) correspond a la loi sur laquelle M. Lhoste 
(1923) a attiry Tattention en faisant valoir ce qui suit. D’une part, 
si une variable aleatoire H a pour intervalle de variations (0, + oo) on 
ne pent sous peine de contradictions (voir Lhoste 1923 ou Dumas 1947) 
admettre k titre d’hypothyse une autre loi de probability a priori que 
celle caractyrisye par dhjh'y d’autre part on ramfene au prycydent le cas 
de la variable P par le changement de variable H ^ (1—^)/P, car 
Fintervalle de variations de H est (0, +oo). Or ^ dhjh correspond 
dp p _ dp 

p* * \-p p(l-2») 

b) La loi •. rtuelle dp}p(\ —p) n’eat paa mathermtiquemeiU abmrde. 
En efifet, pc r e < 0.5 aussi petit qu’on veut, la loi de probability 

1 f # 
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eat bien d4termin6e dans tout I’intervalle do variations (e, L’ap- 

plication de cette loi de probability a priori au cas g^n^ral oti Ton ob¬ 
serve r fois en n ypreuves est 



^ Q 


dp 



i-c 

-—•—dp. 


Comme du fait de la division des deux membres par les facteurs inde¬ 
pendants de p, Fexpression ne depend plus de e que par les limites de 
I’intygrale du dynominateur, et comme cette int6grale a une valeur bien 
determinye pour toutes valeurs possibles de r de w et surtout de b et 
meme pour la valeur limite c == 0, il n’est pas mathymatiquement absurde 
de raisonner sur Thypothfese dp/p(l—p) dans tout Tintervalte (0, 1), 
limites comprises. 

c) L’hypothyse dp/p(l—p) conduit aux resultats que le bon sens per- 
met h lui seul de degager. En voici quelques preuves. Les premiferes 
ont ete donnees ci-dessus dans le paragraphe prycydent. Une autre 
eat qu’avec cette hypothyse, en prysence du rysultat r fois sur w, on a bien 
I’attention attirye sur la valeur* p = rjn, puisque rjn est Veaperance 
mathematique de la loi de probability a posteriori k laquelle cette hypo¬ 
thyse conduit: 


(r-l)! (n-r-1)! 


pr*l(l—p)tt-**-ldp. 


Enfin, avec cette hypothyse, la probability de Farrivye de r fois en n 
ypreuves si Ton sait seulement que dans la meme population on a ob- 
tenu r fois en n ypreuves, est prycisement ygale k Fexpression de Bache- 
lier (voir notre ryponse sans recours k la formule de Bayes) k savoir: 


m (ni—rjF (^—1)! (n—r—1)!’ (n+Wi>-l)! 


N. B, Cette expression est diflferente de celle qu’employait parfois 
K. Pearson et qui correspond k Fh 5 i^thyse dp. D’ailleurs d’une fa 9 on 
gynyrale Fhypothyse dp/p(l—p) est la seule qui conduise tous les re- 
sultats rappeles en (a) k (c) ci-dessus; elle est done la seule k pouvoir de 
pes points de vue fitre retenue. 

Remarque 2: Comparaison de la mithode proposee avec toute autre 
methode 

a) La mythode proposye est supyrieure lb toute autre mythode basye 
sur la formule de Bayes, d’aprys le N. B. qui prycyde. Toute mythode 
sans recours k la formule de Bayes suppose une hypothyse (cf. Frychet 
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1943) et par suite il nous suffit de montrer en (b) oi-dessous qu*hypo- 
th&se pour hypothtoe, le mieux est de faire une hypothise de probabi- 
lit4s a priori, 

b) Toute methode basee sur une hypoth&se de probability a priori 
presente notamment les avantages suivants (voir sur le meme sujet 
mais relajbivement k une loi de Laplace-Gauss: Dumas 1947): (i) elle 
permet de d6terminer compl&tement une loi de probabilite a posteriori 
sans qu’aucune approximation n’ait k etre faite; (ii) elle permet des d6- 
veloppements simples et precis dans le problfeme traits en (c) de la re- 
marque I, sans que Thypoth^se ait k etre faite que la premiire s6rie 
donne une idee exacte de la probabilite p inconnue; (iii) elle permet 
egalement des d^v^loppements simples et precis lorsqu’il s’agit de com¬ 
parer deux r^sultats, puisqu’un raisonnement non indiqu6 ici conduit 
k la loi de probabilite de la variable aleatoire Pi—Pg* difference des 
deux probabilit^s inconnues; (iv) elle permet tenir compte de tout ce que 
Ton connait, meme si cela est vague, et d’en determiner les repercussions 
sur la loi de probabilite a posteriori: si par exemple on sait r fois sur n 
et si on sait de plus que p est petit, il peut etre convenable de passer par 
Tapproximation de la loi binomiale par la loi de Poisson de param^tre 
a et de prendre comme hypothfese de probabilites a priori^ celle carac- 
terisee par daja. 
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6. M. S. B a r 11 o 11 

WITHOUT RECOURSE TO BAYES' FORMULA 
(1) The confidence interval solution. 

To repeat the form of solution discussed by Frechet in “Fondements 
des methodes statistiques d’estimation,” iPortugaliae Mathematica 
5: 3 (1946), 137-141); . ’ 

We may cover the unknown value p^ with a known probability of 
error not greater than s by a random interval with realized value 
(0, 1-e) if the event E does not occur in the single trial, and realized 
value (e, 1) if the event does occur. Given that E has occurred, the 
realised v^lue pf the interval is thus (c, 1), 
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(2) Critical comment. 

The class of estimation problem for which we adopt this form of solu-. 
tion does not affect the validity of the inference (we assume of course 
the correctness of the theoretical model, including the absence of any 
selection, depending on the realized data, which would invalidate in any 
way the particular confidence interval solution made use of); but the 
usefulness of the solution in any problem w^ill be a matter of opi¬ 
nion. It is possible to imagine one type of problem, e,g., in routine sam¬ 
pling inspection in industry, where such inferences are extremely rele¬ 
vant, and another, perhaps of a unique character, where the notion of 
an inference regarded merely as one in a whole set of such inferences, 
may seem rather absurd. 

I reject the quantitative use of Bayes’ formula in estimation problems 
because the a priori probabilities it requires, whether regarded as sub¬ 
jective or objective quantities, are not in my opinion quantities to which 
unique and known values may be assigned. But whatever method of 
estimation is adopted, we should admit that we cannot lay down w^hat 
any person should believe the value of p to be (except the trivial one 
that he would be inconsistent if he believed the value of p to be smaller 
after E has occurred than before). 

7. J. N 0 y m a n 

The answ^cr depends on the precise interpretation of the words “pro¬ 
bability” and “what can one say.” 

It Interpretation of prohabilily, 

a) According to some authors, the value of the probability is in¬ 
terpreted as a measure of “intensity of belief.” To the present author 
this interpretation, applied to actual events, seems both mystic and 
misty. If somebody says that the probability of there being life on the 
planet of Mars is equal to, say, .357 and that this figure represents the 
intensity of belief, I just do not understand it. 

b) According to other authors, and this point of view is shared by 
the present wTiter, the value of the probability is interpreted as the idea¬ 
lized relative frequency of the event E in long series of repeated trials. 
In all that follows, this latter interpretation will be adhered to. 

II. Interpretations of the words: "^What can one say.** 

a) The words “what can one say” are frequently interpreted as 
“what is implied.” This interpretation is frequent in mathematics. 
For example, I can think of the following question: “given that a func¬ 
tion/(«) is continuous in the closed interval {a, b), what can one say about 
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its integrability in the sense of Riemann?” The answer is: The conti¬ 
nuity implies the integrability. On the other hand, the integrability 
does not imply the continuity in the whole interval. 

With this interpretation (a) the answer to the question underlying 
the present enqu6te is that, the appearance of JS a stated number x times 
in the course of n independent trials implies nothing about its probabi¬ 
lity p. In fact, the latter may be anything between zero and unity. 

Some conclusions about the probability p would be possible if, apart 
from the data enumerated in the Question under consideration, it were 
known that the probability p is itself a random variable. In that case 
the formula of Bayes could be applied and the result of such application 
would depend on the knowledge of the distribution function of p. 

b) ‘‘What can one say” may be interpreted as “what should one do” 
or “how should one behave” if faced with the necessity of some action 
whose success depends on the value of p. Imagine, for example, that 

if 0 ^ p < .1 then our preferred action would ho A ^ 
if .1 ^ p < .2 ,, ,, ,, ,, J) n *^2 

etc. Whatever our experiments and observations, the actual value of 
p will remain unknown. However, if faced with the necessity of a choice 
between a number of possible practical steps ...» wo may think 

of establishing a rule of behavior (inductive behavior) which would make 
the proposed action A(x) a function of the observed number x of occur¬ 
rences of the event E in the course of n independent trials. For any 
such rule, R, we could compute the probability, say P{R\p), of the step 
A{x) chosen being actually the preferred one (this may be interpreted 
alsoastheprobability of our statement about the value ofp being correct). 
Every value of p implies a value of P(R\p), Let P*(R) = a be the 
greatest lower bound of P(i?| p). Since in any actual case the value of p . 
is unknown, we may state only that the probability of the rule R leading 
to a success is at least equal to a. The number a so defined is called 
the confidence coefficient relating to the rule R. 

I wish to conclude my remarks with a quotation from my paper in the 
Journal of the Royal Statistical Society, Vol. XCVII (1934) pp. 624-626. 

“Next, let me remark on the criticism of Professor Bowley. I shall 
simplify the position, assuming that we want to determine the propor¬ 
tion, p, of black balls in a bag, and for this purpose we intend to draw 
as many As nr =*. 3 balls (with a Teplacement—for simplicity). The number 
of black balls in the sample will be denoted by X, which may have the 
values 0,1,2,3. Professor Bowley assumes that we actually have 
the sample drawn and that, for instance Z = 3. Having got so far, we 
certainly cannot tell much about the probability of p having any definite 
value. In fact, all we can say is that either an improbable fapt oQcuired, 
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oi* p has a rather large value. But what is done in the method of con¬ 
fidence intervals is different. We start our reasoning, as it were, before 
drawing the sample. Or again, we assume that this is not the only one 
sample with which we shall have to deal. We notice that the sample may 
provide us only with one out of the four possibilities ~ 0, X2 = 1, 
= 2, X4 = 3. Having noticed this, we fix a rule as follows: 

“If in the sample which we shall draw X will have the value 

X =» 0, then we &hall state that 0 ^ ^ 

== 1 , ,, ,, ,, 2 ^ ^ ^2 

“If JT == 2, ,, ,, ,, ,) ^ 8 ^ 2^ ^ ^8 

X = 3, ,, ,, ,, ), >>^4^2^^^ 

We are aware that the statement which we shall make, in applying this 
rule to the result of actual sampling, may be wrong or may be true. 
We calculate the probability, P, that the statement will be a true one, 
and try to arrange the system of values of the -n-’s so as to have p ^ .95, 
whatever the probability law- a priori. 

“In this way, having a sample and knowing that X = 3, we cannot tell 
any more about the value of p than Professor Bowley has stated. On 
the other hand, making statements following the rules set out above, 
we know something important about the results of these statements: 
the probability that we shall be wrong is then ^ .05.’’ 

8. G. Darmois 

SANS RECOVRS A LA FORMULE DE BAYES 

Que peut-on dire si on a observe une fois I’evenement P, de probabilite 
p (inconnue)? 

Ce qu’on peut dire d’abord, e’est que E n’est pas impossible. Et 
en disant cela, on est assure de ne pas se tromper. Nous ne serons 
jamais contredit par un observateur qui, connaissant la valeur exacte 
de la probability p, entend nos r^ponses et les juge. 

Il s’agit de savoir si nous pouvons essayer de donner avec des risques 
appropries, des renseignements plus precis. Evidemment, tout reponse 
precise telle que; la probability p est comprise entre a > 0 et Tunite, 
sera 011 vraie 011 fausse, et dans cette affirmation ou rien n’est aiyatoire, 
il ne saurait etre question de probability d’erreur. 

II n’interviendra de probability que si, considerant I’ypreuve comme 
fournissant un rysultat aiyatoire, nous convenons d’attacher k ce rysultat 
aiyatoire une ^affirmation, ygalement aiyatoire, telle que celle-ci; un certain 
intervalle, determine par I’epreuve, contient la valeur inconnue p. 
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Dans ces conditions, cela a un sens tr&s d^terminA de parler de la 
probability qu’une telle afiSrmation soit vraie ou fausse. 

En particulier, la r6gle qui consiste k attachcr k la realisation de^ 
Fev^nement E, Fintervalle a < p < 1 
ryvinement non-E, Fintervalle a < g ^ 1 
possMe une probability inferieure ^ (is de conduire k une crreur. 

C*est-4-dire quc Fobservatenr qui k chaque fois, juge nos ryponses 
faites d’apris cette rfegle, observers une serie statistique k laquelle il 
donnera une syrie de notes oui ou non, la note non ayant une probabi¬ 
lity intyrieure k a. 

Tout ceci est tr^s exactement conforme k ce que clit M. Frechot dans 
son “Fondements des mythodes statistiques d’estimation.” 

Sans doute la probability dont nous par Ions cst relative k la rfegle 
adoptye, et quand on Fa appliquye aprfes Fyprcuve, on ne sait pas quelle 
chance on a d’avoir raison. 11 est meme assez difficlc de dormer un sens 
prycis k cette question. 

Mais ces difficult6s ne sont nullement attachees k la question des inter- 
valles de confiace. 

Elies sont les memes quand, apr^s une seric de tnesiires, on donne la 
valeiir numyrique adoptye pour la grandeur et la precision qu’on attri- 
bue k ces mesures. 

Une mythode de calcul d’une raesure n^est pas autre chose qu’une 
rfegle qui attache au rysultat aleatoire d’une serie de mesures un intervalle 
aiyatoire, gynyralement dytermine par son centre et sa longueur. 

La chance qu’on a d’avoir raison en disant que la grandeur est dans 
cet intervalle n’a pas de sens precis pour une ypreuve unique, supposye 
faite. 

Remarque, En realite, ni la mythode de'Bayes qui suppose connue 
la loi de probability a priori, ni la mythode des intervallcs de confiance, 
qui ne suppose rien sur Finconnue, ne conviennent gyneralement aux 
probiymes concrets. 

On sait en gynyral quelque chose sur Finconnue que Fon cherche, 
mais ce quelque chose n’est pas aussi prycis qu’une loi de probability 
a priori, 

Et sans etre trfes prycis, e’est pourtant mieux que rien. 

C’est une sorte de pondyration intuitive du domaine ou peut se trouver 
Finconnue. 

Et il semble bien que cette pondyration devienne une pondyration 
a posteriori dont il n’est pas deraisonnable de supposer qu’elle se conduit 
k peu prbs conformyment au thyoryme de Bayes. 

Ces idees, auxquelles j’avais pensy depuis assez longtemps, ont yty 
ravivyes par des conversations avec Mr. Etienne Halphen que Fexpyri- 



ehi5e statistique a auiene k les ai>profondir je devrais dire a les d^couvrir 
et a leur donncr ime forme extremement noiivolle et originaJe. 


En utilisant la formnle de Bayes 

Dans cet ordre d’id^es p est une variable aleatoire qui a une certaine 
loi de probabilite a priori, 

Cette loi a priori, assigne ^ tout intervalle compris entre a > 0 et 
runite une certaine probability Pq (a). 

Aprfes la reussite d’une epreuve, la variable aleatoire p a une loi de 
probabilite nouvelle, iiee par cette epreuve et qui est la loi de probabi¬ 
lity a posteriori. 

•L’intervalle considere precydeminent a, dans cette nouvelle loi, une 
probability Pi (a). 

On pent alors enoncer le resultat suivant: Pi(a) ^ Po(^)> I’ygalite 
n’etant pas exclue, mais n’etani vyrifiye qne si les deux probabilites 
sont nulles. 

Autrement dit, la probability nc peut augmentor pour un intervalle 
qui comprend zyro, elle ne peut diminuer pour un intervalle qui comprend 

ruiiity. 

Pour plus de simplicity, supi^osons que f(p)dj) soit la probability 
yiymentaire a priori. 

pf(p)dp 

La difference P, — P® ^ .... — j f(p)dp 

j pfipyip “ 

0 

est nulle pour a 0 et pour a — 1. 


D’autre part sa dyrivee a pour valeur 



^0= I pf{p)dp = Po (p) 
0 


Le resultat annonce en rysulte aisement. 

La plus grande variation a lieu pour 1’intervalle Aq, I. 

L’espyrance mathymatique a posteriori de p a d’ailleurs une propriety 
analogue. Elio ne peut que crolbre. Mais cette fois, on a yli > ^0. 

52 
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On pent dire encore que la courbe repr^santative de la fonction des 
probabilit6s totales ne pent que descendre aprbs une ^preuve favorable. 

La difference des aires, on Taire com¬ 
prise entre Fq et Fi a pour "valeur 

-^1 — u4o = — en appelant cTq I’ecart 

Aq 

type a priori de 


Fig. 1 

On voit que ce glissement de la courbe des probabilit6s totaks vers 
le contour OPQ qui representerait la certitude, correspond bien k I’idee 
intuitive que nous avons de Teffet d’une epreu\e favorable. 

Rermrqibe, Si Ton veut etudier I’eftet d’une 6preuve complexe, re¬ 
sultant de deux ^preuves successives, Tune favorable, I’autre d6fa\'orable, 
on pent signaler uii resultat analogue. Cette fois, on pent prendie un 
intervalle ne contenant ni zero, ni un. Si, pour plus de nettet6, on prend 
un intervalle sym6trique par rapport i: a = ^ — h, JS = ^ h alors 
la probability, Pi(« fi) ^ Po(otfi)- La concentration de probability, 
au lieu de se faire vers le point p = 1, se fait alors dans la rygion 
centrale. 

La methode precedente, parfaitement nette, exige pour etre appliquee 
concrfetement qu’on ait bien pr^cisy la signification de la variable alca- 
toire ^ et de sa loi de probability a priori, 

9. L. H. C. T i p p e 11 

SANS RECOURS A LA FORMULE DE BAYES 

If an event E has an unknown probability p, and in one trial a success 
occurs, we infer with a certain degree of confidence that p is greater 
than a specific value p^, the degree of confidence for each value of p^ 
being measured by a “confidence ccefl&cient” e = 1 — 

If an event E has an unknown probability p and in one trial a failure 
occurs, we infer that p is less than p^ with a “confidence coefficient” 

of c = po- 

The interpretation of the confidence coefficient is as follows: if the 
above two rules of inference are applied to a large number, of trials, 
for each of which p may have a different value, the inference will be correct 
in a proportion u of the trials, where, in the statistical sense, u tends 
to e as JV tends to infinity. 
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10. M. Kendall 

SANS REOOURS A LA FORMULE DE BAYES 

I^a r^ponse que je donnerais serait basee sur la theorie des '"confidence 
intervals''' que j’ai trait6e dans le second livre de mon "Advanced Theory 
of Statistics'* (voir chapitre 19). 

Le cas partioulier r = 1, n = I est un pen special parce que la proportion 
observee ne peut atteindre que ies deux valeurs 0 et 1. Mais les prin- 
oipes restent les memes. On choisit un niveau de signification (signu 
ficance level), par exemple 5%. Les lignes de confiance deviennent 95% ^ 
des axes des coordon^es et des jmralleles ainsi: 

(i) 

(Ih 

confiance 

Fig. 2 

Si Ton observe / = 1, Fordonnee a / = 1, indique quo I’on doit dire que 
0.05 ^ 0 ) ^ 1. Si / = 0 on dit que 0 ^ w < 0.95. 

Dans le sens de la theorie ces propositions seront realisees dans 95 
pour cent des cas. 

D’lm i)oint de vue different, on pouvait dire qu’on devait rejeter toute 
hypothbse qui donnerait k I’evenement une probability plus petite que 
5%, ce qui conduit la meme conclusion; mais c’est un pen intutif. 

Si Ton me for 9 ait a attribuer un seul nomhre k la valeur de cd, je 
m’appuierais sur le principe de maximum likelihood, et je dirais que co = 1, 
mais pour n si petit Tecart probable est si grand qu’il n’y a pas de justi¬ 
fication pour une mythode d’estimation qui pretend foumir un r^sultat 
gi precis, 

11. R. C. Geary 

SANS RECOURS A LA FORMULE DE BAYES 

The Bureau’s specific problem is solved as follows from the viewpoint 
of the well-known confidence interval theory. Nothing is known about 
the universal probability p of so we must try to make a statement 
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about its magnitude which, if uniformly applied, will be incorrect in a 
proportion of cases to which an upper limit can be placed in advance. 
For the case w = r = 1 the procedure is as follows: 

r If JE' occurs, write < p < 1 1 with p + g = 1 

\lf E does not occur, write « g < 1 J and 0 < <«> < i 

It will be shown that if the experiment be repeated an indefinitely 
large number of times N the joint statement A will be incorrect in a 
proportion P of cases where P < <*> whatever the frequency distribution 
of P itself in the universe. 

Possible universes from which the sample could have been drawn 
can be divided into three categories; (1) those for which p ^ g ^ 

(2) those for which p ^ w, g < <«>, (3) those for which p < “, g ^ w. The 
casep < <«>, g < a cannot arise because p+Q^ = 1 and “ < The following 
scheme shows the number of cases which can arise in each sub-category 
and the nature of the decisions. 



Number of cases 

Decision 

1) Universes Pi ^ gi ^ 

E 

UNtPi 

Correct 

not-jfc’ 

SiVxy. 

Correct 

2) Universes Pj ^ <®, y* < w 

E 

SA^2 Pz 

Correct 

aot'E 


Incorrect 

3) Universes Pa < <», ga ^ « 

E 


Incorrect 

not-E 

SiVaS's 

Correct 


Total N - + SA'g 


In this scheme the 2 applies to all possible universes in each category. 
Nothing is known about the numbers except that they are each in¬ 
definitely large and that their sum is N, 

The proportion P of erroneous decisions is given by 
p = (SATg gg + Pa) / (LNr + + SATj) 

< (SNjj + SNa) / (SATi -f SNg + SA^a) < co 

Hence we are assured that the proportion or probability of error P 
is less than « ^1/2. It is important, however, to note that this conclusion 
does not apply to E and to not-P cases separately» For example the 
proportion of incorrect decisions when P occurs will b© P' given by 
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P'= 'LN^p.^l (ZNiPi +S^aiP 2 + ^^zPz) which is not necessarily 
less than <*> for all values of the Nt, N 2 , and 

The joint statement A has been given by IVt. Frechet.^® The proof 
given above is, however, on somewhat different lines from Professor 
Frechet’s and possibly contains a different basic concept. 

12. L. Fe r a u d 

SANS RSCOURS A LA FORMULE DE BAYES 

Pour commencer restreignons legferement la Question posee et prcnons 
un exemple concret. 

Soit une urne contenant 10® boules parmi lesquelles B blanches et 
(10®—P) noires. On a fait un tirage dans les conditions dites“au hasard.” 
II a donne une boule banche. Que peut-on dire de J5? 

On pent dire d’abord 1 ^ ^ 10® et preraifere vue il semblc que Ton 

no puisse rien dire de plus. Ce qui est vrai en un certain sens. 

Toutefois, si Ton considere toutes les hypotheses admissibles 
J5 1,2, ...,10® 

ne pent on accorder k certaines d^cntre elles une preference? Nous aliens 
montrer dans quelles conditions et ce que Ton peut entendre par Ik. 

II roste k poursuivre la verification de chacune des hypotheses admis- 
siblcs. Siipposons que I’lme d’elles soitadmise, B = Bi. Qu’en fera-t-on? 
On est alors devant un tirage an hasard dans une urne de composition 
connue. D^cidons d*adoi)tcr le degre de probabilit6 a =- 10”®, e’est-a- 
dire de considerer que tout ensemble auquel est affectee une probabilite 
infSrieure ou 6gale k 10 sera vide de resultats. 

Ainsi, au degre de probabilite 10"® et pour un seul tirage: si 1 ^ Bj 
^ 10® on conclura qu’il nc sortira pas une boule blanche, si 10® < B^ 
< (10®—10®) on ne pourra tirer aucune conclusion, si (10®—10®) ^ Bj 
on conclura qu’il nc sortira pas une boule noire. 

Par suite, dans le premier cas et dans le premier cas seulement, la. 
sortie d’une blanche, qui a etc constatee, est en contradiction avec une 
consequence de Thypothfese. L’adoption de tout hypothfese definio 
par un Bi ^ 10® est en contradiction avec le seul fait experimental que 
Ton poss^de. Aucune des hypotheses Bi > 10® ne conduit k une conclusion. 

C’est pourquoi lorsqu’il s’agit de poursuivre la vitrification des diverses 
hypotheses on accordera une preference a cellos qui n’ont pas dejIt 
rencontre un d6menti, e’est-a-dire k la classe B^ > 10®. En d’autres 
termes, on a une raison pour commencer par poursuivre la verification 
des hypotheses B^ > 10®. 

■ Portugaliae Mathematica ( 1946 ). 
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L’enaemble 10* < J5 < 10* est Vensemble de confiance (confidence set) 
dans la terminologie de Neyman et Pearson. II va sans dire qu’il pent 
#tre beauoonp phis restreint et par consequent beaiicoup plus interessant, 
beaucoup plus efficaoe que dans Texemple sch6matique que nous venons 
de considerer. 

Bien entendu, nous ne decidons pas entre les hypotheses admissibles 
d’une maniere absolue, mais nous decidons, et encore provisoirement, 
seulement en vue de oe que nous voulons faire: se servir de I’hypothese 
qui sera admise pour en tirer une conclusion ou degre de probabilite adopte 
10'®. Mais cela determine Taction k entreprendre, au moins dans une 
certain mesure. 

Le mSme raisonnement s’etend evidemment k la question telle qu’elle 
est posee pour n = r == 1 lorsque p n’est plus necessairement une fraction 
de denominateur connu. Si a est le degre de probabilite nous accorderons 
une preference aux hypotheses definies par oc < p <1. L’intervalle (a, 1) 
sera Tintorvalle de confiance. Pour n, r quelconque, la partic du rai¬ 
sonnement qui nous interesse ici reste la meme: le problfeme a ete traite 
par Clopper et Pearson^^ et les graphiques qu’ils ont etablis permettent 
de determiner aisement Tintervallc de confiance pour les dcgres de 
probabilite 0.05 et 0.01. 


13. O. Anderson 

SANS RECOURS A LA FOR MULE DE BAYES 

It seems to me that your proposal d*examiner seulement le cas oun=V^ 
goes too far. My answer to the more generalised questioi^f n > 1 and 
r ^ 1 can be found on pp. 105-119 of my Elnfuhrung in die mathe- 
matische Statistik (Vienna, Julius Springer, 1935). It is preceded (but 
not suggested) by an article by Stanislas Mi Hot, **8ur la probabilite a 
posteriori'’ (Comptes rendus Jtebd, des Seances de VAcademic des Sciences, 
Vol. 176, p. 30, Paris, 1923). Similar ideas are developed by V. Roman- 
owsky and later on by L. Isserlis and R. Prigge. 

Censorship regulations do not permit to send you a full or even short¬ 
ened translation of the text in question. As to the law of large numbers 
and its consequence—the theory of confidence-intervals, I believe that 
they can be based only on the following non-mathematicaJ lemma of A. 
Cournot: events with small mathematical probabilities occur seldom. 
The limit of confidence co is difterent not only for different men but also 
for different degrees of importance of a failure. E.g., the probability 

« The use of confidence or fiducial limits illustrated in the case of the binomial 
{Biometrika, XXVI, 1934, p. 404). 
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1/100 of an imminent rain is regarded as nil, but the same probability 
of an}^ serious typhus or cholera itifection is by no means negligible^ 

14. J. B. D. D e r k s e n 
WITHOUT RECOURSE TO BAYES' THEOREM 

The author agrees with the criticism raised by Mr. R. A. Fisher in 
his book Statistical Methods for Research Workers and in previous 
publications against the use made of the Bayes’ Theorem for the solution 
of the so-called problem of inverse probability. Recurrence to Bayes’ 
Theorem is often found in older textbooks on the theory of probability 
and also among certain present-day authors who seem to adhere to the 
old point of view. 

It will be unneeesmry to repeat the arguments raised by Mr. R. A. 
Fisher and other mathematical statisticians who have stressed the lo¬ 
gical inconsistencies of the hypothesis underlying Bayes’ Theorem. 
The proper solution to the problem how to derive conclusions about 
the unknown magnitude of a parameter specifying a universe if only 
a random sainjile of a finite number of observations are available, is 
given in the theory based on the notion of confidence intervals. This 
theory has been further developed by J. Neyman and E. S. Pearson 
and by others. 

In the simple case stated in the inquiry, where r = w = 1, the confidence 
limits for the unknown value of p are e /2 and 1. On the basis of the 
data of the random sample given, whereby r = » = 1, the only conclusion 
about the unknown magnitude of the parameter p is that it must satisfy 
the inequality l,ifl~-c represents the so-called “fiducial 

probability.” No probability statement can be attached to this 
inequality. 

15. C. J o r d a n 

Since contradictory opinions prevail on most subjects related to pro¬ 
bability, it is necessary to state the definitions relative to what is meant 
by probability. 

According to Ellis’ empirical postulatum,^* when we say that the pro¬ 
bability of an event is equal to p, we mean that we expect in the long 
run, that the event will occur in a ratio nearly equal to p\ from this it 
follows that we expect the event to happen v = wp times in n observa¬ 
tions. Moreover if N sets of n observations are made, the ratio in each 
set is generally difierent and when we say that the probability of the 

Robert Leslie Ellis, “Foundations of the Theory of ProbabilitiM** (TranMCtiona 
of the Cambridge Philosophical Society, Vol, 8, 1842) 
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probability p is equal to («>, then we mean that the ratio p = v/«- will 
occur nearly times in N future sets. 

If we apply our probability-judgment to a single future event, then 
p is only an expression of the measure of the expectation of the future 
event. The greater it is, the more the phenomenon will be expected. 

Our judgment concerning the probability of an event may be guided 
first by theoretical considerations; if there are several possibilities, which 
we consider as equally likely, some of them favorable to the occur¬ 
rence of the phenomenon, and others adverse, then the greater the num¬ 
ber of the first, the more probable the occurrence of the phenomenon 
will seem to us. Finally we shall say that the probability of the event 
is equal to the ratio of the number of favorable possibilities to the total 
number of possibilities, considered equally likely. 

If the results of future observations conform to our expectation, then 
we conclude that our hypothesis concerning the equally likely possibi¬ 
lities was right. 

Secondly, our judgment may derive from past observations. If an 
event has happened times in trials, then according to the empirical 
postulatum, we shall say that Pi = is the most probable value of 
the probability p of the single event, that is we shall expect, that in the 
long run it will occur nearly in this ratio; for instance if in n observa¬ 
tions it occurs X times, then xjn is nearly equal to xjui. This will ge¬ 
nerally happen if n and rii are large, if not then the ratios may bo 
different. 

The occurrence of a phenomenon whose probability is very small 
is not to be expected; but if it happens it is not necessarily surprising. 

1. If the events Ei, occurred respectively x^y x^y 

times in n trials, the probabilities of the events being equal to pi, P 2 •••» 

then the surprisingness^® of this phenomenon may be measured by the 

quantity l—PJPm] where Pj is the probability of the system Xi 

observed and Pm that of the most probable system xi. If is near 

to zero the phenomenon is not surprising at all, if it is nearly equal to 
one, then it is very surprising, so that we must look oat for an error or 
another explanation. 

The a posteriori probability-judgment applied to a past single event 
concerns mainly its surprisingness. 

2. Pearson’s and Elderton’s x test. If starting from the hypothe¬ 
sis -mPb, the probability ^ of a system Xi more probable than 

the observed one is small, then the hypothesis is to be accepted, if it 

Ch. Jordan, “Approximation and Test Criteria: X teat and Bayes’ Theorem” 
{Journal SoeiiU Hongroiae de StcUiatiqm, 1937). 
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is iatge, it must be rejected. . Generally this will lead to the same result 
as the preceding method. :.j . . ^ t 

3. Fisher introduced the notion of the likelihood of the system by 

L -- SaJjlogpi A 

the greater the likelihood the great^,r the probability of the "system p^ 
should be considered. Sihce antilog 'L is proportional to the^ probabi¬ 
lity of the system Xi given by Bernovlli'f< fornuila: •. » < 


( 1 ) 


Fix,) 


nl 

• f’r 




Pi 








hence it is also proportional to the a po^eriori probability of the systeni 
P|, according to Bayes’ theorcDi,{if a priori every system p(\^ considereci 
^equally likely. The likelihood is maximum at the sariie time as 
P{x^), that is if p^ = iTj/n for every value of t. Denoting this maximum 
by Lm* the smaller the difference Lm^I' the likelier the .system pi.. . 

4. The a posteriori probability of a system p\ corresponding to a hy¬ 
pothesis, given by Bayes, formula, divide^l by the a posteriori probabi¬ 
lity of the most probable system' p^ is al^‘ a measure of the reliability 
of the hypothesis. Generally this method leads to the same result as 
the preceding. 

Particular casern = l,;rj = 1, iCg ~ ^3 — ‘^= 0 . The probabilities plj, 

of the events are unknowm. Conclusions concerning the 
hyjjothesis of a certain system p,,P 2 » --mPs required. 

I. .Surprisingness. Tf p^ ^ 1/2 then P(.Ci) = ‘Pm and =, ,0.^ Jf 


1/2 ^ Pi ^ 1/^, we may still have P{x^) = Pm but not necessarily. The 
surprisingness of the occurrence of E depends not only on the probabi¬ 
lity Pi, but on the other probabilities too. For instance: . ^ 

Hypothesis /. p, — 10/100 for i ~ 1,2, ..., 10. Since ” 0 the occur¬ 


rence of E is not surprising at all, and therefore the hypothesis may 
be accepted. 

Hypothesis II, p^ ^ 10/100, p%=pz — p^ = l/lOO^and pio = S2f^00. 
Now 72 — 82; the occurrence of- is surprising enough, *^o .thAt 

the hypothesis should be rejected. ^ ^ n 

2 . Pearson's X theore7n. If Pi ^ 1/2 then ^ -- 0 and the hypothesis 
is to be accepted; if p^ ^ l/.s it is still possitde that $ -- 0 , as for instance 
in Hypothesis I; but it is not necessarily so. In the case of Hypothesis 
XI, the probability of obtaining.» morc: probaWf* sy^temv tfcau .r|i=- I 
is equal to 0.82, therefore this hypothesis is to be rejected. 

3. The likelihood of the system P| in the particidar case* considered 
is L = log pi, it is independent of the other probabilities so that the 
likelihood of the two hypotheses above would be the same. 

63 
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4. The a posteriori profoabilit}^ of the system p^^ according to Bayes* 
theorem is also the same in both cases; therefore the first or the second 
method should be used. 

Remark, If there are but two possibilities: the events Ei and E 2 , and 
if at the first trial the event Ei happened, then the estimation probabi¬ 
lities of the system pj will give nearly the same result by the four 
methods. 

If A > 1/2 then 0 and $ = 0. lfi>i < 1/2 for instance-= 0.1, 

Pi = 0.9 then = 8/9 and ^ = 9/10. The likelihood of the 

system pi, p 2 is equal to /^ = log 0.1, the likelihood of the most probable 
system 1/^ = log 1 ~ 0; antilog jL — 0.1. 

The a posteriori probability of p^, Pa by Bayes’ theorem iSc5^Pi) == 2pdp 
and that of the most probable system = 2dp. Finally 

Sf’ivdIS’- •> 


Without the use of Bayes^ Theorem 

Epitome 

The events Ei, E^, E^ occurred respectively a:,, ...» x^ times in 

n trials, the corresponding probabilities pi, p 2 > •••> are unknown. The 
•acceptability of a certain hypothesis pj, pg, Ps is to be investigated. 
The probability of the system x^ observed, if the a-bove hyi)othesis is 
accepted, is according to Bernoulli’s formula 


P(Xi) = 


n\ 


aji! Xj! ...Xg! 


Pi 


P2 • 


Pb 


Denoting by Pm the probability of the most probable system x^ cor¬ 
responding to the hypothesis, the surprisingness of the occurrence 
of the system x observed will be defined by 


1 _ 

P m 

If t^^is nearly equal to zero, the occurrence is not surprising at all, 

and the hypothesis of the probabilities p| may be accepted. If c^^is near 

to one then the occurrence is very surprising, so that the hypothesis 
should be reject^. 
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In the particular cnee of n = 1 snd *, = 1, x^=x.^=:... =ix,=0 we have 
= Pi. If Pi > 1/2 then P(xi) = P^ and = 0. If 1/2 > J), > l/« 

then P(Xi) may still be equal to P„, but not necessarily; the surprising* 
ness of the events depends on the other probabilities too. Example. 

Hypothesis I. Pi = lO/lOO for i 1, 2,.... 10. Hence P{.Xi)=pi = P^, 
hence = 0 fhe occurrence of is not surprising at all. 

HypothesisII. pi = 10/100, p^=p^ — ... 1/100andpjo=:82/100. 

Now P(a:,) =Pi and Pm = Pit hence = 72/82; the occurrence of E 2 is 
surprising enough so that the hypothesis should be rejected. 

If n = 2 and pi > 1/2 then ^==0. If pi < 1/2 then 

\ ^ 

I-Pi 

16. H. C r a m 6 r 

Allow me first to observe that the discussion on pp. 507-517 of my 
book Mathematical Methods of Statistics covers the essential parts of 
the question at issue, so that .1 may refer to this work. 

Applied to the particular problem mentioned in the Enquete, the main 
points of principle involved in the above-mentioned discussion reduce 
to the following statements: 

1) There are cases in statistical practice, where the application of Bayes’ 
theorem is perfectly kgitimate, and where there exists a well-deter¬ 
mined a priori distribution of the unknown probability p. If, in one 
single observation, the event E (of unknown probability p) has been 
found to occur, Bayes’ theorem then gives a determined value to the 
a posteriori probability that p lies in any given interval Pi< p < p%* 

2) In many cases, perhaps even in most cases, occurring in statis¬ 
tical practice, the conditions for the application of Bayes’ theorem are 
certainly not satisfied. In cases of this character, the calculation of 
an a posteriori probability according to Bayes’ theorem is entirely un¬ 
justified. 

3) Whether the conditions for a legitimate application of Bayes’ 
theorem are satisfied or not, the theory of confidence intervals as deve¬ 
loped by Neyman can always be applied. In the particular problem 
mentioned in the Enqvite, this theory leads to the following results. 
Let e be given such that 0 < c < ^, and let us adopt the following rule: 

When, in one single observation, the event E occurs, we shall assert 
that the unknown probability p satisfies the inequality e 1. 
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Wteih, . on the mother hand, Mi fails to occur, we shall assert that 

^ • ; .s . ^ 

, whatever be the value of the ^unknown probability i), the pro- 

,babiUty of mjd^rig a wrong statement will always be ^ e, 

4) The particular problem mentioned in the Enqu^te does hot allow 
the conclusions of the kind specific to the theory of confidence intervak 
to appear in th^'ir simplest form,-since it'introduces the additional com¬ 
plication connected with a discontinuous distribution. In cases of this 
type, the probability of making a ^wrong statement cannot in all cases 
be made to coincide with the giveh number e-, but can onty be reiidered 
^ c (c/. pp. 513-614 of my book)./ 


Risumi 

This is a report on an inquiry, established by the author, among va¬ 
rious scientists in different countries, asking their opinion about the 
principles of statistical estimation. 

The general problem of statistical estimation of parameters is only 
Considered in a special case where mathematics will not hide the prin¬ 
ciples which are to he discussed: We know the frequency / rjn of a 
rafidom event E in n trials. Admitting that E has a constant though 
Unknown probability p in these n trials, what can we say about p? To 
ifiake'things even simpler, we will only consider the case where 1: 

Knowing that in one trial, E has occurred, what can we say about p? 
Of course, nothing, from the practical point of view, except that E is 
possible. But as principles oTily are questioned, and since those will 
be exactly the same whert n is greater than one, can we say something 
more than 0 ^ p ^ 1, even if the obtained precision has no value from 
the practical point of view ? In this short summary, we will be able 
but to give opinions and judgements based on the answers to the in¬ 
quiry, the full text of which is include<l in the report. 

These answers are varied and conflicting. They examine the quos- 
tibn’from different points of view. 

From'the purely mathematical point of view, it appears that when 
®^®Iusively the classical axioms of the Calculus of Probability, 
it is absolutely impossible to deduce from the fact that /== 1, any other 
infot^atioii about p'than 0 ^ ^ I (even p = 0 being possible). From 

the‘^s^(S jiureily ’ mathematical point of view this statement might be 
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pushed further and be stated in a ease appearing even more paradoxi* 
cal from the practical point of view: a point chosen at random on 
segment might fall a million times successively on the middle of this 
segment though, each time, the probability of this event should be zero. 

Thus, to derive information from the knowledge of /, about the value 
of p, it is necessary either to invoke a practical principle not belonging 
to the axiomatic Calculus of Probability or to modify (lightly in appear¬ 
ance) the considered problem without changing the hypotheses by mo¬ 
difying the question, or by modifying slightly the hypotheses. 

We may suppose that there is a definite a 'priori probability law of a 
random probability P which is the considered trial was equal to p. In 
that case the Bayes-Laplace formula^ enables us to answer the modi¬ 
fied question: What is the a posteriori probability that P =* p (or p < P 
< p-fdp) in the categories of trials where E was realized. 

Generally the a priori probability law of P, when existing, is unknown, 
but often we know something in advance which enables . us to have 
some information about p and from that we may derive, if not the a 
posteriori probability law of P, at least some information about; this 
law. 

Furthermore, several authors have proved that supposing some very 
general conditions to be fulfilled by the a priori probability law of P, 
the a posteriori law of P converges to one easy-to-define probability law 
of P when n increases indefinitely. 

But mam’^ others do believe that in most practical circumstances not 
only is the a priori probability law of P unknown, but also that it has 
no meaning. There are two ways of escaping that difficulty. 

First we may use a Cournot’s lemma: an event which has a very small 
probability may practically be considered as impossible; or in a modi¬ 
fied form suggested by a Divisia remark: in practical life if an event 
has a very small probability, we may act as if it were impossible. Start¬ 
ing from this and admitting that when an event has a probability small¬ 
er than <i> > 0 I for example, <0 = were 

impossible, it is easy to prove that when E of probability p, has been 
realized in one trial, we may act as if w ^ p ^ 1, an inequality w^hich 
solves the problem in principle (though from the practical point of view 
it does not differ essentially from 0 ^ p ^ 1). 

1 While it is stated sometimes that Laplace restricted to the case of a uniform 
a priori probability law the general formula given by Bayes without supposing 
equal the a priori probabilities, it is just the reverse which is true (Bayes still pre¬ 
ceding Laplace for the particular case). 
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In that inequality is the ‘‘confidence coefficient;” it is essential 
to keep in mind that nothing in the previous reasoning allows one to 
say that it is the probability that this inequality hold true. For, in 
this reasoning this probability is 0 or one, as p is no more what it w as 
when applying the Bayes-Laplace formula, a random element. 

Some authors strongly object to Cournot’s lemma, although perhaps^ 
it is true, they would accept its modified form. They may save the si¬ 
tuation by adopting the following last point of view which is favored 
in most of the answers. In many cases estimation of parameters must 
be done by professional operators. And it is only wanted that these 
operators do not often make mistakes. 

Then suppose each of them should apply the following i?w rule: 

When E occurs in one trial, it is estimated that w ^ ^ ^ 1 

When E does not occur in one trial, it is estimated that 

0 < l^iu 

Then it can be proved that the probability that an operator makes a false 
estimation is smaller than w whatever be the value of p, whether it be 
constant, chosen through a fixed rule, or random. 



ftAiSONNEMfeNt li^DUCTIF OtJ COiviPORtfeMENT 
INDUGTIF ? LES CONCEPTIONS MODERNES 
DE LA STATISTIQUE MATHEMATIQUE 

par Jerzy Neyman 
Directeur du Lahorcttoire de stcUiatique 
de VTJniveraite de Californie (Etats-Unis) 

1. On a exprime Topinion que le oalcul des probabilites et la statis- 
tique mathematique ferment la base d*un proc6d6 mental qu*on nomme 
“raisonnement inductif.** Si Ton convient4 n’employer le mot “rai- 
sonnement” qu’4 la description de precedes qui conduisent au savoir, 
le raisonnement ne saurait etre que deduotif. D'autre part, comme il a 
6{i6 signale en 1937 [1],^ il y a lieu d’employer le terme “comportement 
inductif.” On entend par ce terme les rbgles, plus ou moins generates, 
d'ajustement de nos actions aux resultats d'observations Hmitees. 

Le calcul des probabilites et la statistique mathematique jouent un role 
important dans la formulation de ces rigles. Certainement il y a assez 
de raisonnement, mais, comme d'habitude, tout raisonnement est de- 
ductif. 

2. Le progrfes humain est du aux “permanences" ou plut6t k notre 
aptitude reconnaitre les permanences dans les objets qui nous entou- 
rent, ainsi que dans les changements de ces objets quo nous appelons 
les phenom^nes. 

Parmi les “permanences" qui ont 6t6 remarquees les premieres, doivent 
etre les dimensions des objets, au moins les dimensions de certains 
objets. Par consequent les dimensions sont consider^es comme des pro- 
prieles des objets et on a invente des rfegles pour les mesurer. Lorsqu'on 
a reconnu que, dans certains cas, les dimensions changent, on a 
cherch6 k discerner les “permanences" .dans ces changements. Pour un 
grand nombre de classes de phenom^nes, les “permanences” discern^es 
dans le passe ont 6t6 retrouvees ulterieurement. Ceci a cre6 I'habitude 
de regler nos actions en tenant compte de permanences qui, pour le 
moment, semblent etre 6tablies. C'est justement ce. que j'appelle le 
comportement inductif. Souvent il conduit aux resultats desires. 

3. Au 17i^me et au ISi^me si^cles une nouvelle classe de. “perma¬ 
nences" a ddcouverte. On la doit aux joueurs de jeux de hazard 
sur le continent de I’Europe et aux francs-ma 9 ons en Angleterre, 
Les “permanences” discern6es auparavant 6taient les dimensions, les 

^ Los chiffres entre crochets carr^s indiquent les refti^nces correspondantes 
enregistr^es di. la fin de cette communice^ion. 
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distances, les poids, etc. Les permanences nouvelles s’attachaient k des 
experiences qui, considerees^se^arement, ne permettaiont pas de pre- 
voir les. resultats. Neanmolns/bn a remarque que les frequences rela¬ 
tives de rbsultats possibles de ces experiences, r^petees un grand nombre 
de fois, resteiit a peu pr^s invariables. 

Le premier tricheur au jeu de des, qui a pense 4 piper ses des pour faire 
amener plus souvent les chiffres desires, a ete Tauteur de la conception 
nouvelle que la frequence relative, avec laquelle un de tombe sur une 
de ses faces est une “permanence”; c’est une propriete de ce de qui 
est mesurable et oonstante tout comme ses dimensions ou son poids. 

Les francs-maQons en Atigleterre ont fait une decouverte semblable 
concernant le decfes de personnes du meme age qui vivaient dans les 
memes conditions. 

Une fois ces permanences discernees, il a ete relativement facile de 
construire les conceptions abstraites correspondantes, dont I’ensemble 
constitue la theorie des probabilites. Gomme d’habitude, les concep¬ 
tions nouvelles ont trouve des applications utiles comme guides dans 
le comportement indiictif. Telles semblent etre les origines du calcul 
des probabilites et de la statistique mathematique. 

4. 'II me' seirible que la statistique mathematique est un chapitre du 
calcul des probabilites. Les problbmes statistiques sont ceux du calcul 
des probabilites qiii se rattachent le plus etroitement aux problbmes 
du comportement inductif. Les exemples qui suivent servent k edair- 
cir la distinction un peu delicate entre les problfemes de probabilite au 
sens strict et ceux de la statistique mathematique. 

La question que le C h e v a 1 i e r de M e r e adressa lb F e r m a t, 
sur la probabilite P pour qu^en un jeu de 24 coups de deux des “bons” 
on artibne le “double six” une fois au mbins, est une question de prb- 
babilite au sens strict. II est probable que la reponse de Fermat, lb 
savbir: P = 0,491 a servi au Qheviblier de Mere comme guide sur quoi 
parier, c’est-lb-dire, comme une r^gle du comportement inductif. Dans 
tous ces cas oh les des etaient bons, il fallait parier centre le “double 
six”. 

Pour citer lin exemple des problemes de la statistique mathematique, 
nous allons envisager les doutes que le Chevalier pouvait avoir s’il avait 
lb jouer avec des dbs inconnus, dont Thonnetete etait suspecte. J*iina- 
gine qu’il pouvait observer un oii deux jeux de 24 coups sans jouer et se 
decider lb jouer et lb pariir apres avoir pris connaissance des resultats. 
Par exemple, il a pu adopter des rbgles de comportement inductif comme 
les suivantes: 

. . (ry De ne* parier w le “double six’’ dans le deuxifeme jeu et les 
suivants que si le “double six” a ete arqene au moins une of is danlse 
premier jeu, et de parier contre le “double six” dans le cas contraire. 
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(ii) De ne parier 8ur le “double six” dans le deuxifeme jeu et les 
suivants que si le “six” a 6t6 amen6 neuf fois au moins pendant le pre 
mier jeu et de parier contre le “double six” dans le cas contraire. N. B., 
Si les d6s sont bons, alors 8 est Tesp^rance math^matique du nombre 
des “six” dans un jeu. 

(iii) De parier sur le “double six” dans le deiixi^me jeu et les sui¬ 
vants si le “double six” a 6t6 amen4 au moins deux fois dans le premier 
jeu. De parier contre le “double six” dans le deuxi^me jeu et les sui¬ 
vants si le “double six” n’a pas apparu pendant le premier jeu. Enfin, 
si le “double six” a 6t4 amen6 une seule fois, de rester spectateur du 
deuxi^me jeu en lui appliquant la rfegle (1). [2] [3]. 

II est probable que plusieurs regies semblables ont 6t6 invent^es dans 
le pas36. Trouver les proprietes de telles rhgles de comportement inductif 
qui possedent de telles proprietes donnees, est le prohleme de la statistique 
mathimatique, 

Le comportement bas6 sur les rfegles (i), (ii), ou (iii) se distingue essen- 
tiellement du comportement dict^ par la r4ponse de Fermat au Che¬ 
valier de Mer6. Dans le cas present, Tadoption d’une des regies (i)- 
(iii) d^terminait les actions du joueur comme une fonction du r^sultat 
al^atoire du premier jeu ou des deux premiers jeux. Par consequent, 
les actions elles-mfimes obtenaient un caractfere aleatoire. 

Generalisons: la statistique rmthematique a pour hut d'etudier les 
proprietei de telles regies de comportement inductif qui determinent nos 
actions comme fonctions hien definies des valeurs observees de variables 
aliatoires. 

II nous faut expliquer ce qu’on entend par les “proprietes des regies 
de comportement inductif.” Si le Chevalier de Mere avait adopte une 
des regies ci-dessus, pouvait etre pour une seule raison: pour aug- 
menter la frequence des cas oh il aurait parie sur le cas favorable, c’est-h- 
dire, dont la probabilite est au moins un sur deux. II s’en suit que 
les proprietes interessantes des rfegles de comportement inductif sont 
celles relatives k la frequence avec laquelle on peut atteindre les resul- 
tats desires dans les cas differents pourvu qu’on adopte une telle rfegle. 

5. En etudiant les problfemes multiples que je me permets d’attribuer 
au Chevalier de Mferfe, nous avons parie de la plupart des conceptions 
de la statistique mathematique moderne. Pour preciser, designons 
par une seule lettre Jfo 1®* totalite des variables aleatoires observables. 
Les valeurs de ces variables vont etre interpretfees comme les coordon- 
nees d’un point aleatoire dans un espace W, Soit x une des posi¬ 
tions possibles de dans W. Soit C une classe de sous ensembles w 
de W sur laquelle la probabilite P{X^ e w} = se trouve definie. 

Nous allons considerer le cas oh la fonction $o(^) inconnue sauf 
qu’elle appartient h une famille F de fonctions de repartition des 

64 



426 INTElRNATIONAL Sl’ATISTICAL CONFBREKCIS: I St 

probabilit^s ^(w), toutes d^iinies sur la meme classe C des sous 
ensembles w, 

D 6 crivons la situation d’une manifere diff^rente. Outre la variable 

dont les valeurs particuLferes seront fournies par Tobservation, on 
considire toute une famille, soit de variables aleatoires Toute 
variable X^ d^finit la position du point al 6 atoire dans le meme espace 
W et la probability pour que ce point-ci tombe dans un sous ensemble 
w e C est donnye par la fonction e F. On salt le variable 

X^ appartient k la famille F^y on ne connait pas son identity. 
C’est une autre caractyristique des situations considyryes qu 3 , comme 
e’etait le cas de de M 6 re, on est forcy de faire un choix entre des actions 
appartenant a un ensemble A d’actions a possibles. Si Tidentity de la 
variable nous ytait connue, les circonstances du probleme auraient 
dicty le choix d’action d’une manifere bien claire. De plus, supposons 
que pour toute fonction de la famille F et pour toute action possi¬ 
ble a de Tensemble A une fonction ^(a/^) nous est fournie qui repre- 
* sente le ‘‘gain” qui aurait rysulty de Tadoption de cette action a dans 
les cas oil la fonction reprysente la loi de probability de la 

variable X^. 

Soient 6 jP et Ui et deux actions do Tensemble A telles que 
Alors, si ropresenty la loi de probability de 
Xq, Taction est prefyrable 4 Taction a^. La fonction peut etre 

appeiye la fonction de pryferenco des actions. 

Dans le cas du Chevalier de Myry la variable aiyatoire observable X^ 
peut etre identifiee avec le syst^me de 24 variables 1, 2, ..., 24). 

Pour le ^-iynle coup de deux dys, dyfinissons la variable Tj comme le nom- 
bre des “six” amenys par ce coup. C’est- 4 .-dire, les valeurs possibles 
de sont 0,1 et 2 . L’ espace W est composy de “points,” chacun 
k 24 coordonnyes, soit ti, ..., <24 toutes capables des valeurs zyro, un 
et deux. Chaque point a; de TT reprysente un rysultat possible d’un jeu 
de 24 coups; done il reprysente une position possible du point aiyatoire 

Soient et les probabilitys d’amener un “six” avec le premier 
et le second dy respectivement. En adoptant Thypothyse plausible 
d’indypendance, la probability pour que X^ possfede une position dyter- 
minye x etre ycrite: 

( 1 ) P{^o = 

=[(1 -Pi°)a -^2°)] -?>2“)4-p*'(i -1)1°)] [i)i° p/] 

oh Wo+^ 1+^2 “ 24. Cette probability dyfinit d’une manifere yvidente 
la fonction de rypartition des probabilitys $o(^) de la variable X^, Si 
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Ton ignore les valeurs de. p°j et p% excepte que ce sont des nombres 
positifs plus petits que un, alors on est conduit it considdrer toute une 
famille F de lois de repartition qu’on peut maintenant designer 

par 4>('M’|PiPa) toutes etant definies par la formule 

[(i -7>i)( 1 [i>i( I -Pa) +P 2 ( 1 -Pi)] [pi Pa] 

dans laquelle p^ et P2 designent des nombros arbitraires entre zero ct un. 
Par conSi6quent, la famille F est, dans le cas considere, une famille 
de fonctions k deux param^tres jPi et Pg- Si Ton veut on peut aussi, k la 
place de la famille F, considerer une famille corrcspondante F^ dc vari¬ 
ables Xpip 2 dont les lois de probability sont donnees par ^(u^lPiP 2 )- 
Done, par exemple, dfeigne Ic r&ultat al^atoire d’un seul jeu k 

24 coups de deux des dont le premier a une probability 1 /»5 d’amcner un 
“ six ” ct Ic second une probability 1/7. On ne sait rien sur la variable 
Xq, excepty qu’clle appartient a la famille F^. Le Chevalier dc Mery 
se trouvait confronty avec la nycessite du choix entre deux actions pos¬ 
sibles; a^deparier le‘Vlouble six” ou a2 de parier sur le ‘'double 

six”. Done, dans ee cas, rensemble A d’actions possibles ne possede 
qu3 deux yiements ct ag* Pour tout yiement la famille 

F la fonction de pryference doit ctre definie pour ces deux actions 

seulojnent. 8i Ton considere les details des regies du jeu, la definition 
de peut ebre assez compliquye. Pour simplifier, definissons 

^K|^pip 2) 1 ^ S \ avec les valeurs 

evidentes dans le cas contraire. 

Retournons au cas general et considerons la regie R du comportement 
inductif comino suit: si Vobservation donne — x Vaction ado 2 )tee sera 
une action a(x), ou a(a’) est une fonction definie pour tout x e: IL dont les 
valours sont dans A. La fonction a{x) s’a])pelle la fonction de decision 
statistique. Les regies (i) et (ii) considyryes ci-dessus sont des exemples 
de la regie R. Pour la regie (i) la fonction rt(a;) — a^ toutes les fois 
qu’aucune des coordonnees de x est ygale a 2. 

Pour toute fonction ^(w) de la famille F definissons une variablealea- 
toire, soit 

= 4'[a(X^)|^]. 

L’ensemble des variables ou plutot Tensemble de leurs lois de ry- 
partitiori de probability est appele la caracteristique operationelle de la 
regie R du comportement inductif. 

Dans le cas du Chevalier de Myry, la caracteristique operationelle de 
la rfegle (i) est une fonction dc p^ et p 2 et representc la probability 
qu’en pariant selon la rfegle (i), on parie sur le cas dont la probability est 
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plus forte que II est Evident que connaStre les propri6t68 d^tuie rdgle 
de comportement i? est connaltre sa caract4ristique opSrationelle. 

6. Le terme''rdgle de comportement inductif’* suggire bien la con¬ 
ception pour laquelle il a invents, mais il semble aussi prStenctieux 
que le terme raiaonnement inductif/* Done il pourrait etre pr6f6rable 
d'employer le terme “ proc6d4 statistique ’’ pour designer Tajustement 
de nos actions aux valeurs observ4es des variables al4atoires. 

7. Les premieres r&gles du comportement inductif ou les premiers pro- 
c6d& statistiques dont la th6orie a 6t6 4tudi6e sont ceux dont la fonc- 
tion de decision (i(x) n a que deux valeurs. Les proc6d6s statistiques 
de ce genre sont connus comme les proc6d48 de verification des hypo¬ 
theses statistiques. La caracteristique operationelle d’un proc^de de 
verification est connue comme sa fonction de puissance. [4] [5] [6]. 

Presque simultan6ment la theorie d’un autre genre de precedes statis¬ 
tiques a ete etudi^e, celui de I’estimation statistique au moyen d’un 
intervalle. Cette theorie est connue comme la th6orie des intervalles 
de confiance. [7] [1]. 

Ces deux theories, celle de verification des hypothfeses statistiques 
et celle des intervalles de confiance ne sont que des cas particuliers de 
la theorie g^nerale des proc^d^s statistiques (~ des rfegles du comporte¬ 
ment inductif). Cette theorie gen^rale est due k Abraham Wald. [8] [9]. 
Dernierement un grand nombre de travaux importants ont 6t6 publies 
se rattaohant aux divers aspects de ces theories, mais je ne puis citer 
que quelques auteurs. 
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Resume 

In the past, claims have been made that mathematical statistics and 
the theory of probability form the basis of some mental process des¬ 
cribed as “inductive reasoning.” If it is agreed to limit the meaning 
of the word “reasoning” to those mental processes which lead to know¬ 
ledge, then all reasoning seems to be deductive. On the other hand, 
as was first remarked in 1937, there seems to be room for the term 
“inductive behavior.” This may be used to denote the tentatively 
general rules which adjust our behavior to limited amount of obser¬ 
vation. 

In establishing these rules, both the theory of probability and statis¬ 
tics do play an important role, and there is a considerable amount of 
reasoning involved. However, as usual, the reasoning is all deductive. 

Human progress is based on permanencies or, rather, on our ability 
to detect permanencies both in the objects surrounding us and in chan¬ 
ges in those objects which we describe as phenomena. 

With many phenomena the permanencies observed in the past often 
were noted in the same classes of phenomena observed later. This 
created the habit of regulating our actions by referring to the established 
permanencies. This is inductive behavior. 

In the 17th and the 18th centuries, a.new kind of “permanency” was 
detected by gamblers on the continent of Europe and by Masons in 
England. Previously detected permanencies were dimensions, distan¬ 
ces, weights, etc. The newly detected permanency was the relative fre¬ 
quency with which a particular result recurs in repeated trials in which 
the outcome of any single trial is unpredictable. 
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The first gambler who thought of “loading” a die is the author of the 
concept that the relative frequency with which the die falls with six 
dots up is this die’s permanency. 

Once these permanencies were noticed, the corresponding abstract 
concepts were easy to create. The postulated long run relative fre¬ 
quency received the label of probability and found useful applications 
in forming our inductive behavior. This was the origin of the calculus 
of probabilities and of mathematical statistics. 

The theory of mathematical statistics is part of the theory of pro¬ 
bability and statistical problems are most directly generated by the 
problems of inductive behavior. 
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Discussion 

Mr. G i n i suggested to Mr. N e y m a n that mathematical statistics 
should not be restricted to being a segment of the calculus of probabi¬ 
lity. He noted further that the “permanences” exist independently, 
and that he thought it unnecessary or inappropriate to consider the ap¬ 
plications of probability theory to statistics as rules which deal with in¬ 
ductive behavior. 

Mr. Gini then turned to the question of accounting for past experience 
in ascribing preference to one or another hypothesis. He stated that 
the means of verifying the hypothesis suggested by Mr. Neyman takes 
account only of present experience, and thought, therefore, that such a 
method should be applied only when there is no past experience. He 
refused to proceed as if the a priori probability did not exist, and saw a 
danger in the application of the modern theories of probability simply 
to get conclusions at any cost. 

Mr. Hotelling pointed out the influence of philosophical prag¬ 
matism on the discussion of problems of inference. By this pragmatic 
subordination of the idea of belief to the idea of action, statisticians have 
turned to questions of determining which of alternative actions to take 
(acceptance 8t rejection of a hypothesis, selection of statistical methods 
of making decisions). Mr. Hotelling believes that only through the em¬ 
phasis on action can statisticians make great progress where there is a 
multiplicity of available decision or action. Mr. Hotelling noted that 
cases of multiple decisions have naturally and almost necessarily led to 
repeated experiments and samplings, to sequential analysis. 

Mr. H u r w i c z commented that the divergency of views of Messrs. 
Neyman and Gini is only apparent, pointing out that Mr. Neyman’s 
procedure provides in a particular problem for a class of admissible dis¬ 
tribution functions, whose choice will be dictated by previous knowledge. 

Mr. Rubin discussed the use of previous data, stating that they 
cannot bo rigorously treated unless the mechanisms by which earlier con¬ 
clusions were arrived at are known. An a priori probability cannot be 
set up because no probability for the original hypothesis can be derived 
from the original data. 

Mr. Bernstein pointed out that exclusion of a priori probabi¬ 
lities would render impossible much work in medical statistics and gene¬ 
tics, where the experience of laboratory genetics has given indications 
about the a priori probability of the hypothesis when data concerning 
humans are limited. 

Mr. Bernstein continued, to oppose the viewpoint of Messrs. Neyman 
and Hotelling that this purpose is to find rules of behavior. He statde 
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his belief that the human observer is a secondary element in the study 
of nature, and that there is no justification to be drawn from pragmatism 
for a changed attitude throughout natural science. 

Mr. Eisenhart proposed two examples to focus attention on the 
fact that more than the favored hypothesis must be considered, that the 
function of a statistician is to give advice in the use of data as a basis 
for decision. In both, one is led to the formulation of statistical tests 
in terms of the admissible decisions and acceptable risks of errors. 

Mr. N a n d a illustrated, with a discussion of sampling for agricul¬ 
tural information, the ways in which past information may be used in 
the design of samples. 

Mr. Marschak added a few remarks on the development of theo¬ 
retical economics and the preoccupation with the theory of choice 
rational behavior or what happens if people try to maximize their uti¬ 
lity). This utility is described as a function of certain actions. 

Mr. T u k e y said that the statistician cannot often enter into the 
question of deciding whether a given theory fits the facts well enough for 
present purposes—a viewpoint adopted in physical or biological science 
where it is expected that hypotheses will be modified. The problem 
of statistics is to guess what methods will work out well where the hypo¬ 
thesis used to set up the methods is not exactly true. 

Mr. Hurwicz foresaw a difficulty in enforcing one element of the pro¬ 
cedure described by Mr. Neyraan as statistical inference, namely thut 
the action must be prescribed by the rule, which is a well-defined func¬ 
tion of observable random events. 

Mr. Wald replied briefly to a question put by Mr. Marschak on the 
decision problem and the minimax principle as a rule for beha\rior. 

Mr. F r e c h e t proposed a hypothesis which might reconcile those 
who will not take into account the application of the Bayes-Laplace for¬ 
mula. He also expressed the opinion that there is a place both for the 
scholar who wishes to understand what has happened, and for the sta¬ 
tistician whose function is to determine courses of action. 

Mr. Neyman commented that his views should not be interpreted to 
mean that a priori probabilities should not be utilized in such cases (as 
genetics) where they have a meaning, and stated that the question of 
principle under discussion is whether the theory of rules of inductive 
behavior has meaning. A further question is whether cases exist where 
there is no a priori probability, or where the a priori probability is un¬ 
known. Mr. Gini reaffirmed his views that such cases are very infre- 
quetlt, and added that even in the cases of multiple decision the a priori 
probability of each hypothesis must be oo^iieidered. He concluded with 
tho pirtdiotion that after further study divergent views will be 
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At the time, now about thirty-five years ago, when first I came to 
study statistical methods, nothing was further from my thoughts, or 
from those of my contemporaries, than that the art of experimental de¬ 
sign would ever come to be, as it now surely is, an integral part of the 
subject. The horizon was indeed filled with j)roblems of fitting, or as 
we should now say, of estimation; and the two primary tests of signi¬ 
ficance, Pearson’s test, and Student's test, though certainly not widely 
understood, were already available, though in the case of still in a 
form that ignored the degrees of freedom. The mathematical theory 
of all these aspects of statistical methodology was frankly in chaos. 
No step forward was possible without concurrently clearing up a number 
of errors and misapprehensions, only indirectly connected with the mat¬ 
ter in hand. 

The line of statistical thought which led most directly to the problems 
of experimental design, was undoubtedly the Theory of Estimation, 
devoted to the study of the distributional properties, in appropriately 
chosen sets of samples, of the various possible estimates, or estimators, 
which may be used to estimate the unknown parameters in the problem. 
Even though at this stage of discussion no thought was given to the 
manner in which the data were obtained, but these data were considered 
as an immutable part of the problem, yet it gradually became clear that 
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absolute criteria existed by which one estimate might be judged, with¬ 
out ambiguity, to be better than another, and that in the Method of 
Maximum Likelihood the practical worker possessed a tool providing 
estimates which even in theory could not be improved upon. 

In the course of this work it was shown that one valid method for the 
comparison of estimates was supplied by the amount of information 
relevant to the unknown parameters, this quantity being a scalar for a 
single parameter, and a symmetrical matrix in general. It was rigo¬ 
rously demonstrated that the amount of information extracted in the 
process of estimation could never exceed the quantity supplied by the 
data. 

This fnding, combined with the practical fact that directly available 
processes of computation would extract almost always a very large frac¬ 
tion of the total available, shifted the moral balance. The statistician 
was no longer responsible for the accuracy or precision of the results of 
his labors. His business became much less like that of a conjurer who 
is expected to work wonders, and more like that of a chemist who under¬ 
takes to assay the proportion of gold in a sample of ore. He need not be 
ashamed if the assay is low, or elated with pride if it is high. Consc quently, 
provided he used available methods of proved competence, and did his 
arithmetic right, the statistician had no longer any responsibility for 
the value, or for the worthlessness, of his estimates. The vcight 
of his responsibility was thrown back on to the process by which the 
data had come into existence. 8o, armed with the concept of amount 
of information as a practical tool, statisticians came to study what 
forms of experiment, or what types of observational programs would 
yield the most information for a given expenditure in time, money, and 
labor. 

The purpose of these introductory remarks of mine will have been ser¬ 
ved if I have made clear the logical necessity of this step in the history 
of the subject, by which interest shifted from the problem of minimi¬ 
zing loss of information in the processes of statistical reduction, to the 
problem of maximizing the amount of information created by a well 
planned expenditure of experimental resources. There i? but one fur¬ 
ther point I need make. 

The only modification of the art of experimentation, as developed on 
statistical principles, which does not fiow directly from the requirement 
to maximize the amount of information, obtainable with limited re¬ 
sources, consists in the introduction into the experimental procedure of 
what is called randomization. The theory of estimation presupposes 
a process of random sampling. All our conclusions within that theory 
rest on this basis; without it our tests of significance would be worthless. 
In order to justify the conclusions of the theory of estimation, and th^ 
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tests of significance as applied to counts or measurements arising in the 
real world, it is logically necessary that they too must be the results of 
a random process. In controlled experimentation it has been found 
not difficult to introduce explicit and objective randomization in such 
a way that the tests of significance are demonstrably correct. In other 
cases we must still act in the faith that Nature has done the^ randomi¬ 
zation for us, as for example, when we conduct a series of variety trials 
over a period of five years, and draw our conclusions as if the weather 
experienced in these years were really a random sample of five out of 
an infinite population of seasons determined by the climate prevailing 
at the site of experimentation. In all cases, however, we now recog¬ 
nize randomization as a postulate necessary to the validity of our con¬ 
clusions, and the modern experimenter is careful to make sure that this 
postulate is justified. 

My few remarks. Ladies and Gentlemen, are aimed at displaying the 
seed and roots of this young plant; later speakers will I hope tell us 
something of its flowers and fruit. 


Resume 

L’auteur expose le developpement des idees ay ant conduit, via la Theo- 
rie de TEstimation, a T^tude des plans d’experiences. 

On s’approfondit d’abord sur le probleme de minimiser la perte d*in- 
formation dans le proefes de reduction d'un ensemble d’observations, 
plus tard sur le problfeme de rendre maximum ia valeur informative 
resultant d’une utilisation aussi efficient que possible des ressources 
disponibles. L’on a introduit aussi dans la procedure experimentale 
Texigence de fortuite. 
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Discussion 

Mr. Bose presented the following brief commentary on the work 
in experimental design which has been carried on in India, in the Indian 
Statistical Institute and the Calcutta University. 

“...The three basic principles of‘experimental design’ are randomiza¬ 
tion,‘replication’and‘local control.* As F i 8 h e r has remarked, design and 
analysis are two aspects of the same logical whole, and randomization 
and replication are necessary in order that valid tests of significance, 
based on the use of t and z tests should be possible. In order, however, 
to increase the efficiency of the experiment, local control is necessary. 
The main principle is to divide the experimental material into relatively 
homogeneous parts called ‘blocks.* In the well known randomized 
block design every treatment is applied to one randomly chosen experi¬ 
mental unit within each block, and the analysis is so arranged that the 
block effects are eliminated in making treatment comparisons. When, 
however, the number of treatments is large, then the differential responses 
of the experimental units within the same block swell the error, and make 
the experiment inefficient. We have thus to find a way of reducing 
the block size, and this has given rise to the device of ‘confounding*, 
the use of‘incomplete block design.’ The incomplete block designs most 
commonly in use are the ‘lattice designs’ and the ‘balanced incomplete 
block designs.’ In the latter, v treatments have to be arranged in h blocks 
of k experimental units each so that treatment is replicated r times, and 
each pair of treatments occurs together in A blocks (the number A 
being independent of the pair of treatments we start with). It is readily 
Boen that 

hk = vr, X(v - 1) = r(k -1) 
and Fisher has shown that 

h >v 

“Qiven the parameters v, b, r, k, A, satisfying the above conditions, 
the combinatorial problem of actually producing the required arrange¬ 
ment still remains. The practically useful cases are when r g 10 and a 
number of these were listed in Fisher and Yates tables. But many blacks 
remained. Indian workers have succeeded in filling up most of these 
blanks; some of the new solutions were included in the second edition of 
Fisher and Yates table, and other are going to be included in the forth¬ 
coming third edition. 

“The total number of available balanced imcomplete block desij^ 
il Unfortunately very restricted. To a certain extent the deficiency is made 
Jood by lattice desings, in which though every pair of treatment is not 
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compared with the same accuracy, the analysis is simple and straight¬ 
forward. In order to fit with various experiments which arise in prac¬ 
tice, a much more flexible system of designs is required, A more general 
system of designs, viz.^ the partially balanced design, has been worked 
out by the statisticians of the Calcutta School, in which the stringent 
combinatorial restrictions to which balanced incomplete block designs 
are subject have been slightly relaxed, without losing the advantage 
of simplicity of analysis. The number of the these designs (not all of which 
have yet been worked out) is very large, and gives ample scope to the 
experimenter to choose a design according to his requirements . 

“ A special feature of the theoretical work done in India on the cons¬ 
truction of designs has been the consistent use of methods and concepts of 
Modern Algebra, especially the theory of Galois Fields and Finite Geo¬ 
metries. For example, a finite geometrical representation, has been found 
extremely useful in connection wdth the theory of the symmetrical 
factorial design, where its use easily leads to an exhaustive enumeration 
of all the possibilities of confounding in a given situation. 

“Much work on ‘asymmetrical factorial experiments,’ ‘two-way arrange¬ 
ments,’ both factorial and non-factorial, and separation of complete 
replications (in the case of incomplete block designs), had also been done 
in India, but it is impossible in this short time to give details...” 

Mr. R a s c h gave his attention to two points which ho felt deserve 
more consideration than they usually receive, and which show how 
biologists and statisticians may gain by yielding to each other’s views: 

( 1 ) Choice of experimental object. The decision on the fundamental 
question : What is to be observed? is too often left to the common sense 
of the biologists. Dr. Rasch cited an experiment in Avhich the collabora¬ 
tion between biologist and statistician was highly profitable and which 
pointed to the desirability of using preliminary studies with tlie aim of 
securing effective observations. He continued: 

..But would it be possible to develop a Theory of Design of Prelimi¬ 
nary Experiments? Undoubtedly! The alternative possibilities must, 
of course,be selected by the biologist after a discussion of the importance 
of the biological specifity of the reactions recorded.- But a theory for 
the choice between the alternatives offered can be elaborated on the 
basis of the theory of reaction curves. 

“To give a brief indication of an approach to the problem I shall assume 
the reaction curve to be linear with slope p and the variation of the 
observations about the reaction line to be normal with the variance cr^. 


The mean error of the usual estimate of the mean reaction dose is 3 

r P 

times a factor largely depending on the allotment of the animals to the 
doses. 
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Therefore, if the computation of that estimate is the main purpose of 
the experiment, the observation with the least value of a should be 
preferred.” 

(2) Interpretation of systematically arranged experiments. Mr. 
Rasch described a simple serial arrangement which has been used in 
Denmark. He believed that when there must be some definite cause 
of variation, randomization is not to be preferred to research intended 
to reorganize that cause so that it may be accounted for in a systematic 
design. 

Mr. Fisher commented on Mr. Rasch’s remarks on systematic design 
in agriculture, that his process of fitting a polynomial in order to remove 
residuals might also be done with a randomized arrangement. Thus, 
this cannot be described as an advantage of a systematic over a random 
arrangement. 
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DESIGN IN BIOLOGY 

The Utilization of Experimental Data for Improving Deaign 

by George W. Snedecor 
StalUtical Laboratory, Iowa State College {United States) 

The results of a well designed and well conducted experiment contain 
information not only on the subject being investigated but also on the 
improvement of the design for further trials. After extracting from an 
experiment the evidence which is immediately desired, the investigator 
is prone to abandon the data, proceeding to further experimentation 
without utilizing the knowledge that could be had about improvement 
of the design itself. Some even go to the extreme of repeating the same 
experiment time after time, only to learn at the end that the plan was 
inefficient or inadequate. This is wasteful of both time and money. 
The purpose of this paper is to illustrate the method of examining two 
experiments in which the design turned out to be susceptible to improve¬ 
ment. 

The first illustration is based on a factorial experiment to learn the 
ascorbic acid content of snapbeans stored for four periods of time (2, 4, 
6 , and 8 weeks) at each of four temperatures (0°, 5°, 10®, and 20® F.). The 
beans to be used were all harvested under uniform conditions before 
eight o’clock one morning. They were prepared and quick-frozen before 
noon of the same day. Three packages were assigned at random to each 
treatment. The twelve packages to be kept at 0® F. were placed at 
random in the storage compartment, three being removed for analysis 
at the end of each storage period. In addition, twelve packages were 
quick-frozen, then tested at once for their ascorbic acid content. On 
each package there were two determinations of the concentration of the 
vitamin: The averages are recorded in Table 1. 


Table 1 

Average Concentration of Ascorbic Acid in Snapbeans 
(mg. per 100 g.) 


storage Dime 
(Weeks) 

Storage Temperature (Fahrenheit) 


0“ 

5° 

10° 

20* 

HHHH 

16.2 




2 


14.2 

14.9 

11.4 

4 

16.7 

16.0 

14.3 

«.2 

« 

16.4 

14.4 

13.7 

7.0 


18.5 

13.2 

12.3 

S.9 
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I'he two sets of regressions, on storage time and on temperature, were 
examined for curvilinearity. The former were linear, starting at a coih- 
mon level at the initiation of the experiment and tending downward 
with their negative slopes increasing with temperature. The latter were 
parabolic, starting at a constant vitamin concentration at 0" F. (unaffec¬ 
ted by time of storage) but with rate of loss increasing with duration of 
storage. These considerations led to the adoption of the following sur¬ 
face as the empirical model 

(1) y = a + fiST + yST'^ + c, 

where F, /Sf, and T represent respectively ascorbic acid concentration, 
length of storage period, and temperature of storage. 

Since three packages were tested at each temperature-storage treat¬ 
ment, the sampling variance was available at 17 points on the surface. 
This variance turned out to be homogeneous, unaffected by either tem¬ 
perature or time. This warranted the use of equal weights in making 
the least squares estimates of the regression constants. The fitted equa¬ 
tion was 

(2) y 15.55 - 0.01437- 0.002735^^2, 

with ~ 0.8995. The analysis of variance is summarized in Table 2. 


Table 2 


Analysis of Variance of Ascorbic Acid Concentration in Snapbeans 


Source of Variation 

Degrees of 
Freedom 

Mean 

Square 

Total 

119 


Regression Constants 

2 

631.2 

Deviation of Means from Regression 

14 

4.14 

Deviation of Packages from Means 

43 

1.411 

Differences between Readings 

; 60 

1.375 

For deviations of means, 

F = 4.14/1.411 = 2.94. 

J’.ox = 

2.45 


It is evident that the vitamin concentration of the packages deviated 
significantly from the regression surface. This raises the question as 
to whether the empirical equation is adequate to describe the population 
regression. The available evidence is displayed in Table 3. 

56 
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Table 3 

Deviations of Treatment Means From Regression Surface 


Storage Time Storage Temperature (Fahrenheit) 

(Weeks) 0^ 5° 10° 20° 


0 

+0.7 




2 1 

-0.5 

-1.1 

+0.2 

-1.4 

4 

+0.2 

+ 1.0 

+0.4 

-0.8 

6 

-0.1 

-0.3 

+0.7 

-0.3 

8 

0.0 

-1.2 

+0.2 

+0.8 


A deviation of 1 unit is significant at the 5% point 


Four of the 17 points deviated more than the significant difference, 
three of them being at the 5° storage temperature. This suggested that 
a more flexible surface might be required; consequently, the equation 

(3) Y = a+ fiS + yS^ + 8ST + + e, 

was fitted. This allowed parabolic curves in both directions, which 
seemed to be indicated in some similar experiments on other products. 
The resulting fit was not so good as that of the simpler equation: 
jRa = 0-8621. Doubtless cubics would have the fit; but the propriety 
of using such elaborate functions with limited data is doubtful. Since 
the distribution of positive and negative deviations in Table 3 is fairly 
unsystematic, it was decided to accept the simple model tentatively 
and to explore other possibilities of explaining the excess of large devia¬ 
tions. 

The only flaw detectable in the design was this: between eight o’clock 
and noon, some of the snapbeans may have lost ascorbic acid while 
standing in the uncooled room. The remedy would be to prepare the 
packages and send them to the quick-freeze chamber in batches or blocks, 
each batch containing one package per treatment. This randomized 
blocks design would insure for all treatments one package from each 
processing period: if there is any loss due to standing, it will be equa¬ 
lized among the treatments and will also be eliminated from error. This 
modification of the design is being tried. Perhaps it will be learned 
whether this explains the significant deviations of the treatment means 
from regression. 

The other information concerning improvement of the design came 
from the analysis of variance of the two determinations of ascorbic acid 
which were mcide on each package. Here is made the assumption that 
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the nonrandom deviations from regression have disappeared so that the 
package variation within treatments is the appropriate estimate of error. 
The mean square for differences between readings (1*375, with standard 
error 0*247) may be taken as an estimate of the variance, cr^, of a normal 
deviate. The mean square for packages then becomes + <7^, where 
(Tp* is the component of variance associated with packages. Thus cTp* 
is estimated by 

™ _ 0.018, 

2 

with standard error 0*193. .,, ^ 

With estimates of these two variances, the potential efficiencies of 
similar experiments may be examined under various cost situations. 
If P stands for the number of packages and E for the number of readings 
on each in the redesigned experiment then the estimated amount of 
information is 


(4) 


1 _ PR 

1.375 + 0.018P 


Furthermore, representing by G the cost of a reading relative to unit 
cost of a package, the cost of evaluating a treatment mean will be 

(5) • P(1 + RC) 


The maximum amount of information for a specified cost may be shown 
to correspond with 


( 6 ) 


R 


^ J 1.375 
\0.018C 


p _ _^0 

018(7 1+^^’ 


where (7 q, the predetermined cost of a treatment mean, is here taken 
as the original expenditure in this experiment, 3(1 + 2(7). 

Usually P, as determined from (6), will be a fraction: then the nearest 
integer is to be chosen as the optimum value, P'. The corresponding 
value of R is 


(7) 




(7o-P' 

PV 


The associated optimal amount of information will not be much different 
from the maximum. As compared with the original, the newly designed 
experiment may be expected to yield more information for the same 
cost. 

As illustration, examine first the case in which the cost of an asc^ 
acid determination, (7, is one-fourth the cost of materials,, labor 
storage of a package. 
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Then, since Vl .375/0.018 = 8.74 and 1/0 = 4, 


R = 8.74^4 = 17.48, = 3(1 +2/4) = 4*5, and P = 


_ 4 ^^ _ 

1 + 17.48(174) 


= 0.84 


Taking P" = 1, the optional number of readings per package is 




4.5-1 

1(1/4) 


14 


At the same expenditure of funds, the redesigned experiment may be 
expected to furnish (equation 4) 


(1) (14) 

1.375+ (0.018)(14) 


= 8.605 


units of information instead of the original 4.252 units, a relative effi¬ 
ciency of 202%. This may be compared to the maximum relative effi¬ 
ciency, 204%. 

If the cost of materials and storage is not charged to the experiment, 
as is usually the case in experimental work, the cost of chemical analysis 
and packages may be about equal; whence 0 = 1. This assumption 
leads to P' = 1, R' = 8, and relative efficiency equal to 124%. 

The experiment as conducted was approximately 100% efficient at 
the cost C = 19. 

Among other vegetables investigated, broccoli offers some interesting 
contrasts with snapbeans. The mean concentrations of ascorbic acid 
in the several treatments. Table 4, show a tendency, at the lower tem¬ 
peratures, first to decrease then to increase with length of storage. 


Table 4 


Average Concentration of Ascorbic Acid in Broccoli 
(mg. per 100 g.) 


storage Time 

(Weeks) 

Storage Temperature (Fahrenheit) 

0° 

5° 

10° 

O 

o 

0 

68.3 

• 



2 

67.9 

65.0 

61.0 

66.3 

4 

64.4 

61.9 

69.7 

47.0 

6 

69.2 

62.3 

64.3 

39.6 

8 

69.1 

64.7 

60.6 

37.6 
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Th© explanation of this is not known. There are chemical interactions 
among the ascorbic acid and related compounds, but no reasonable 
explanation of this peculiarity has been suggested. 

In this circumstance, one would usually retain the reasonable equation 
used to fit the snapbean data. !Hut since the objective here is to study 
the structure of the experiment, a more flexible surface was adopted, 
the curves being parabolas in both directions. The fitted equation was 

(10) 69.20 -3.7016f + 0.4650>Sf2 -0.1259^97^ -0.000481 

with 0.7446. The analysis of variance is shown in Table 5. 


Table 5 


Analysis of Variance of Ascorbic Acid Concentration in Broccoli 


Source of Variation 

r ■ 

Degrees of 
Freedom 

Mean 

Square 

Estimation of 
Variance Components 

Regression 

Deviations of treat¬ 

4 - 

2,256 


ment means 

12 

81.48 


Packages | 

42 

50.38 

Sp= = 24.678 

Readings | 

59 

1.032 

.s* = 1.032 


While the deviations of treatment from regression are not significant, 
the one at ^9 — 6 weeks, T = 5° is —7.2 units, almost twice as great as 
the largest deviation. This deviation was attributable to one package 
whose two readings were 48.9 and 39.4 compared to the average reading 
60.2 for packages having approximately the same regression value. 
Apparently, something happened to this package; it is doubtful if the 
new design of randomized blocks will account for so extraneous a value. 

From the components of variance it is clear that with any ordinary 
cost relp/tions only one reading need be taken on a package. Only if 
the cost of a package were 96 times the cost of a reading would the maxi¬ 
mum information be got by taking two readings per package. 

With one reading per package, the number of packages with constant 
total cost is 


( 11 ) 


yju 

i + o 


It is easily found that, as two examples: 

(1) If 0 = 0.25; P' = 4, ///o=131% 

(2) If 0 = 1; P' = 5, Ilh = 163% 

There is no intention of intimating that a redesigned experiment will 
produce just the information predicted from the die in hand. Even 
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after repeated trials there will be the inevitable sampling variation. 
Besides, the effect of uncontrolled environmental conditions, such as 
weather, is usually not adequately known. To make allowance for 
these contingencies it is wise to provide a moderate flexibility in the' 
design. In the experiment on snapbeans, at least two packages could 
probably be retained for each treatment under any reasonable cost 
situation. 

Another great advantage of flexibility is this: some modiflcation in 
design is often feasible after the preliminary data are available for ex¬ 
amination. In the case of snapbeans, for example, one set of packages 
is assayed for the vitamin immediately after quick-freezing, providing 
new and more intimate estimates not only of cr^ and o*p^, but also of the 
costs. Based on this knowledge, the number of readings on the stored 
packages may readily be adjusted to increase prospective information. 

It may be in order to place greater emphasis on this utilization of 
statistics during the progress of an experiment, especially one that ex¬ 
tends through several phases or seasons. Experimenters are prone to 
leave until the last minute the more revealing parts of their statistical ana¬ 
lyses. When the experiment is completed and the summaries are finally 
made, it often becomes obvious that much of the potential information 
was lost through lack of an efficient design. This could usually be 
avoided by thoroughgoing examination of the data at each stage of the 
experiment. In some instances, complete redesign or even abandon¬ 
ment may be indicated. Probably in most cases modifications will 
increase efficiency. 

The experiments discussed above are quite inflexible because all the 
material had to be prepared and stored in advance. But it may be 
worth noting that the data on packages which were not stored could have 
been analyzed statistically during the first week. The results in Table 
6 would have been available: 


Table 6 

Analysis of Variance of Packages Quick-Frozen but Not Stored 


Source of 
Variation 

Degrees of 
Freedom 

Mean 

Square 

Estimates of 
Components of 
Variance 

Packages 

7 

Snapbeans 

0.833 

0. 

Headings 

8 

2.047 

2.047 

Packages 

10 

Broccoli 

71.622 

35.465 

Readings 

— 11 

0.692 

0.692 
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I’or both products, the indicated changes in design are substantially the 
same as those revealed at the end of the experiment. But two queti 
dififerent courses of action would be indicated. For the snapbeans, 
there would be no point in discarding any of the packages because their 
cost has already been incurred; that is P is fixed at 3; and therefore, for 
no change in total cost, R = 2. But it would have been clear that in¬ 
formation could be increased in proportion to the number of readings 
per package. If readings were cheap or if increased information were 
highly desirable additional readings might have been decided upon. 

In the case of broccoli, the extra reading on each package was clearly 
not very productive of information. If readings were expensive, it 
might have been decided to save half their cost at the sacrifice of a small 
amount of information: For P = 3 and R—l, the ultimate amount of 
information in this experiment would have been decreased only 2% at 
a saving of 3(7 in the total cost per treatment. For (7=1, this is a saving 
of one third on each of the remaining treatments. 

The second illustration presented in this paper is drawn from a similar 
kind of investigation, one in which the keeping quality of snapbeans 
was tried with five storage-temperature treatments. The storage periods 
were zero, three, and six months: during the latter two, there was main¬ 
tained a temperature of 0°F together with an oscillating temperature 
between 0° and 10°. The oscillation was intended to simulate the con¬ 
ditions in a home freezer. For each treatment three packages of the 
beans were prepared and frozen on each of four successive days, that is, 
in four lots. The variable measured was flavor, assayed organolepti¬ 
cally by four judges. 

It was clear to the designers that one of two effects would be con¬ 
founded. If some of the beans were held in storage before the treat¬ 
ments were applied so that all storage would end at the same time, the 
effects of the preliminary holding would be unknown. On the other 
hand if the treatments were to begin coincidentally, assays would 
be made at three month intervals and at each period the judges would 
be aware of the storage treatment which had been applied. Since the 
interest was in the contrast between steady and oscillating temperatures, 
the latter horn of the dilemma was chosen. 

Looking at the experiment as a whole, the analysis of variance in Table 
7 shows that the judges did not agree as to the differences among treat¬ 
ments: the judge X treatment interaction is large relative to JTL = 6.56. 
Clearly, if the judges are assumed to be a random assortment, this dis¬ 
crepancy is a real source of error in testing treatments, and should be 
combined with the randomized blocks discrepance, PL = 8.20. 
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Table 7 

Analysis of Variance of Scores of Four Judges on the Flavor of 


Snapbeans Kept Under Five Storage-Temperature Treatments.® 


Source of 
Variation 

Degrees of 
Freedom 

Mean 

Square 

Estimates Furnished by 
Mean Square 

Treatment 

4 

34.61 

+ 3(7^j' 1X -f- Ic^tLP 1 

-f- 12(T’\L“f-48cr^T 

Lot (Day) 

3 

6.30 


TL 

12 

8.20 

4" 3o'^jtl “h 4 (T^tlp 1 

Packages 

40 

3.52 

or*+4(r®TLP 

Judge 

4 

65.90 


JT 

12 

38.16 

<r*+3(r®jTi. +12<r*jT 

JL 

9 

9.19 


JTL 

36 

6.56 

<r*+3o-VL 

JP 

120 

2.64 

tr** 


^^JLT = i .307 , 

^633,~ 

= 0.220, = 0.063 


The mean square with component, 

(T^ + 4t7'\Lp "1“ -f- 12 (T^xl> 

can be estimated by 

TL+JT- JTL = 8.20 + 38.16 - 6.56 = 39.80, 

and since this is greater than the treatment mean square, the treatment 
differences may be only sampling variation. 

In other experiments of this type, a test of the significance of treatment 
effects is needed. An approximate test was suggested by Daniels.^ 
Since three mean squares with unity coefficients are involved in the 
estimate of error, the F-test may be used with degrees of freedom, 

(TL+JT-JTL)^ 

—- : - =-12 

(TLY AJTY, (JTLf 
12 12 36 ■ 

This gives F = 34.61/39.80 = 0.87 with degrees of freedom 4 and 12 for 
the approximate test. 

It became evident from both this experiment and the one on ascorbic 
acid that the nutritive value and the flavor of snapbeans were unaffected 
by storage at the constant temperature of 0° F. This indicates a 
method of avoiding the confounding pointed out above. It seems that 
the beginning of the storage periods with higher temperatures can be 
a Dr. A. M. Mood kindly furnished the components of variance. 

» Supplement to the Journal of the Boyal Statistical Society, 6:186 (1939). See, also, 
Satterthwaite: Psyehometrika, 6;309 (1941); and Biometrics Bulletin, 2;110 (1946). 
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delayed so that all the treatments can be completed at the same time 
without impairing the estimates of vitamin concentration and flavor. 
The variously treated products can then be presented to the judges in 
unknown and random order, thus eliminating from the treatment means 
the effects of possible prejudices on the part of the judges. 

Whether this will decrease the judge x treatment interaction remains 
to be seen. Observation of many experiments raises a strong doubt 
that it will. The hazard of disagreement among judges lowers the pre¬ 
cision of most such trials: the coefficient of variation in this one was 
31.4%. 

As before, the efficiency of allocation of experimental facilities may 
be examined. The information per treatment mean is 

__ PLJ _ _ 

P “h “f" PPs^TJ "1“ P^S^TL 

while the . cost of a treatment mean is 

PL(l + JCh 

where C is the cost of a judgment relative to unit cost of a package. 

Examination of the information function leads to the conclusion that, 
for any chosen values of J and of PL, the information might have been 
increased by decreasing P (unless ctxl = ^jtl = 0). This fact was avail¬ 
able before the experiment was performed. Had the experimenters 
been aware of it, they probably would have made P = 1 and L—12 with 
what turned out to be an increase of 10% in information with no in¬ 
crease in cost. So far as statistical efficiency is concerned, a single indi¬ 
vidual per plot always wins. 

Substituting P—\ together with the values of the variance compon¬ 
ents from Table 7, information becomes 

LJ 

3.947 + 2.633i. 

It is now clear that for any fixed number of judgments, LJ, information 
is maximized by minimizing the quantity, 

2.633i> + 0.283«7, 

which is done by taking JjL = 2.633/0.283 ( = 9.3 approximately). Evi¬ 
dently the original design could be improved by increasing the number 
of judges at the expense of lots of packages. Furthermore, the cost 
would be decreased, because, for any constant product, LJ, the cost, 
L + LJC, decreases with L, This means that, in the experiment produc¬ 
ing maximum information at a fixed cost, JJL "^9.3, It turns out that 
57* 
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in this optimum experiment, for values of C in the neighborhood of 
unity, JjL is little greater than 9.3. As examples, 

if C = 1, J = 23.9, L = 2.41, JjL == 9.9 

if 0 = 0.25, J = 30.7, L == 2.76, JjL = 11.1. 

The necessity of choosing integral values for L and J lessens the import¬ 
ance of the distinction between the optimum value of JjL and the value 
JJL— 9.3. Practically, the optimum experiment may be specified by 
L—3 and J = 2S. The information to be expected from this redesigned 
experiment is 352% of that in the original. 

The inefficiency of the original design resulted chiefly from the large 
component of variance, 52 jt = 2.633. Should this be typical (there is 
some evidence that it is not unusual), the fact must be faced that infor¬ 
mation gained by organoleptic methods is expensive. Since large num¬ 
bers of judges are not feasible, increasing information can be got only 
at the expense of expanding the number of replications. Each incre¬ 
ment of information is gained at the expense of an additional number 
of dollars per unit. 


Resume 

Les r6sultats d’une experience bien menee d^apres des plans bien 
prepares, renseignent non seulement sur le sujet etudie, mais encore sur 
les ameliorations k apporter au plan en vue d'experiences scmblables 
ulterieures. Aprfes avoir retire de Texperience les resultats immediats 
qu’il desire, Texperimentateur est tente d'abandonner les donnees, et de 
proceder a une autre experience sans tirer profit des connaissances qui 
auraient pu ctre obtenues en ce qui concerne Tamelioration du plan. 
Certains meme, vont jusqu’a rep6ter la meme experience plusieurs fois 
de suite pour finir par arriver a la simple constatation que le plan 6tait 
inefficient ou incorrect. Cela signifie un gaspillage de temps et d'argent. 
Dans la presente etude, Tauteur donne une illustration de la m6thode 
d’analyse de deux experiences dans lesquelles le plan apparait etre sus¬ 
ceptible d’amelioration. 

Une experience “factorielle” a ete faite pour determiner la diminu¬ 
tion du contenu d’acide ascorbique de haricots verts conserves, pendant 
4 periodes (2, 4, 6, et 8 semaines), k chacune des 4 temperatures: 0, 6, 10, 
et 20 degres F. Troispaquets de haricots furent soumis k chaque traite- 
ment. Pour chaque paquet on determina, par deux mesures, la con¬ 
centration de la vitamine. Leurs moyennes sent donnees dans le Tableau 1. 
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Tableau 1 

Concentration moyenne d*acide aacorhique dans lea haricota verta 
(mgr. par 100 gr.) 


P6riode de conservation 
(Semainos) 

Temperature pendant la conservation (Fahrenheit) 
0“ 6" 10'’ 20'’ 

0 

16.2 




2 

16.0 

14.2 

14.9 

11.4 

4 

16.7 

16.0 

14.3 

9.2 

6 

16.4 

14.4 

13.7 

7.0 

8 

16.5 

13.2 

12.3 

5.3 


L’equation Y = a-}-fiST a ete ajustee aux observations, 

oti Yy Sy et T representent respectivement la concentration d’acide as- 
corbique, la duree de la conservation, et la temperature pendant la con¬ 
servation. 

Tableau 2 

Analyae de la variance de la concentration d'acide aacorhique dana 
lea haricota verts 


Source de variation 

Degree de liberty 

Carre moyon 

Coefficients de regression 

2 

531.2 

Ecarts des inoyennes par rapport 



la r6gression 

14 

4.14 

Deviation des paquets par rap¬ 


1.411 

port aux moyennes 

43 

DiflTeroncos entre les mesures 

60 

1.375 


La moyenne par paquet presentant unc deviation significative de la 
surface de regression, il faut constater que la methode des blocs repar¬ 
tis au hasard pourrait etre adequate. II y a alors pour chaque traite- 
mont un seul paquet provenant d^une periode de preparation. 

La valeur informative a ete examinee sous differents rapports entre 
les frais de mesure de la concentration d’acide ascorbique et le cout d’un 
paquet, L’experience telle qu’elle a ete menee offrait un resultat op¬ 
timum seulement si les frais d’une mesure etaient 19 fois le cout d’un 
paquet. Les mesures etant relativement moins cheres que le montant 
correspondant a ce rapport, un plus grand nombre de mesures par pa¬ 
quet et un plus petit nombre de paquets aurait procure un montant 
d’information plus eleve par unite de frais. 

Dans une experience similaire, la saveur et d’autres qualites du pro- 
duit ont ete jugees organoleptiquement par quatre juges. La conclu¬ 
sion principale etait la suivante: les juges etaient en si grand desaccord 
dans leurs jugements de la qualite, que I’information par unite de frais 
peut etre rendue maximum seulement si Ton augmente sensiblement 
le nombre de juges. 
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Discussion 

Mr. Yates gave a few examples of the value of examining experimental 
results to improve accuracy in future experiments on similar material. 
In the first, he wished to decide how far “compounding” was worth¬ 
while. By use of experimental data, he had learned how valuable the 
Latin square is, relative to randomized blocks. In the second, Mr. Yates 
wished to discover whether rotation of treatments, eliminating animal 
differences, produced more efficient results than constant treatments, 
eliminating carryover effects of treatments. 

Mr. Sukhatme noted that research in the theory of experimental 
design has been confined to modifications of factorial design, by devices 
like compounding, fractional replication, etc. He believes that, since 
factorial experiments are practicable only at large experiment stations, 
there should be more appreciation of the utility of small experiments, 
for purposes of measuring the effect of improvements introduced on the 
basis of results from large experiments. Mr. Sukhatme described a 
sampling plan which has been in use in India for such experiments. An 
important factor was that the design in each farmer’s field had to be kept 
very simple. 



LIMITATIONS AND POTENTIALITIES OF THE 
APPLICATION OF THE THEORY OF EXPERI- 
MENTAL DESIGN IN SOCIOLOGY 

by Margaret Jarman Hagood 
Bureau of Agricultural Economics^ Department of Agriculture 
(United States) 

The theory of experimental design, as developed by Professor R. A. 
Fisher, has had far less application in the social sciences than in the 
biological sciences; in fact, examples are almost nonexistent. Therefore, 
it seems appropriate first to examine the reasons for the limitations, 
so as to reveal the areas in which the theory does have potentialities of 
exploration and also to reveal wider areas in which the Fisher methods 
of analysis may be applied to data not obtained through experiment. 

Sociology Not Primarily an Experimental Science 

The phenomena involved in the central problems of sociology, as in 
the case of economics and political science, are relatively nonmanipu- 
lable for research purposes. Experimentation in the sense that a given 
treatment or combination of treatments may be applied to observational 
units with specified characteristics and the results recorded for statis¬ 
tical analysis is not generally feasible.^ For example, the sociologist 
cannot take action to initiate disruptive forces in communities or groups 
he may be studying, even though he may be able to conceive of an ex¬ 
periment that would test the efficacy of various measures for combatting 
disruptive forces. Similarly, an economist who has a hypothesis as to 
the type of fiscal policy that would bring about quick recovery from a 
depression cannot decree a series of depressions in which alternative 
policies could be tested in order to determine experimentally the validity 
of his hypothesis. Some fifty years ago an editor of Sir William 
P e 11 y's and Captain John G r a u n t's economic and population 
writings ascribed the development of Political Arithmetic, “a beginning 
of what is now called statistics,’' to the very fact that the experimental 
method is precluded in economic investigations.* 

> Sociologists are by no means in agreement in usage of the term “experiment” 
in sociological research. For a review of current conceptions on the nature of the 
experimental method, see Ernest Greenwood, Experimental Sociology: A Study in 
Method, New York, King’s Crown Press, 1946, pp. 7-18. 

* The Economic Writings of Sir William Petty together with the Observations 
upon the Bills of Mortality More Probably by Captain John Qrauni^ edited by 
Charles Henry Hull, Cambridge, 1899, p. Ixv. 
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In the areas of social research where experiment is impossible, at least 
for research workers, it seems necessary to grant that the principles of 
experimental design cannot be directly applied. This does not mean, 
however, that the methods of Professor R. A. Fisher have no potential 
contribution to social research. 

Areas in Which Experimental Design is Applicable 

In certain research areas of sociology which deal with individuals 
or small groups and with ‘‘innocuous’* treatments, experiments can be 
carried on and the theory of experimental design can be applied. For 
examples of application of the Fisher principles of design of experiment, 
however, it is necessary to go outside the field of sociology to closely re¬ 
lated disciplines. I have been unable to find .any published account 
by a United States sociologist of a sociological experiment designed ac¬ 
cording to Fisher’s theory.® In the United States, educational psy¬ 
chologists and statisticians have gone further than have any other psy¬ 
chological or social scientists (including general, animal, and social psy¬ 
chologists) in the use of Fisher’s methods. A survey of experimental 
studies in education made during a recent three-year period found “ap¬ 
proximately equal representation of studies using the earlier methods 
and those using the Fisher approach,”^ although the latter classifica¬ 
tion included some nonexperimental studies that had employed Fisher’s 
methods for analysis of the data. The experiments described in that 
survey included subject matter very closely related to that with which 
certain specialized sociologists deal and they might very well serve as 
suggestive guides in planning experimental studies in the field of social 
psychology, which sociologists as well as psychologists claim as their 
province. 

A related area of promise for experimental method is in the develop¬ 
ment and perfecting of tools for measurement of social phenomena. For 
example, in the pretesting of schedules for use in social surveys, experi¬ 
mental design might often replace purposive or purely random methods 
in choice of units on which alternate versions of a schedule or scale is to 
be tested. 


» Of the nine experimental studies described by F. Stuart Chapin in Experimen¬ 
tal Designs in Social Research (New York, Harper and Brothers, 1947), none relies 
on Fisher’s theory for design of experiment, although in some cases Fisher’s methods of 
analysis are utilized. Only four of the studies reviewed involved measurement 
before and after some “treatment.” 

* Charles C. Peters, Agatha Townsend, and Arthur E. Traxler, Chapter IV, 
“Research Methods and Design,” in “Methods of Research and Appraisal in Educa¬ 
tion,” Review of Educational Research, Vol. 16 (1946), p. 377. 
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Applicability of Fishkh’s Methods to Analysis 
OF Social and Economic Data 

It is in the process of analysis of nonexperimentally obtained data 
that Fisher’s methods seem to hold greatest promise for social sciences. 
The first published examples noted in this country appeared not quite 
ten years ago. In December 1937, Friedman published an article 
in which analysis of variance was applied to data on family expendi¬ 
tures.® Shortly thereafter an unemployment census volume was pub¬ 
lished in which D e d r i c k and Hansen used analysis of variance 
for examination of the significance of regional differences in unemploy¬ 
ment.® Other published examples were infrequent until the last few 
years when they have become more numerous."^* 

The conditions for applicability of Fisher’s methods of analysis to so¬ 
cial and economic data are quite broad. Many types of quantitative 
data, gathered with sufficient identification to permit classification ac¬ 
cording to relevant criteria, may be appropriately subjected to analy¬ 
sis of variance and covariance. 

The methods are especially appropriate when the problem is one of 
establishing the existence of differentials and exploring factors that are 
associated with differences. In its present stage of incomplete develop¬ 
ment into a science, sociology has many such problems in a wide variety 
of subfields. Sociological statisticians or, more correctly, sociologists 
with statistical competence who engage in quantitative social research, 
increasingly use Fisher’s methods, if one judges by published works. 
And it is likely that in sociology, as in the case of educational psycho- 
logy, the quantitative analyses made by graduate students in connec¬ 
tion with their doctoral dissertations utilize these modern statistical 
methods to an even greater extent. 

In summary, sociology will probably never become wholly or primar¬ 
ily an experimental science. But in certain areas of research that border 
on educational and social psychology, experimentation is feasible and 
there is no reason to believe that progress will not be made in the adop¬ 
tion of modern principles of experimental design. Of more importance 

» Milton Friedman, “The Use of Ranks to Avoid the Assumption of Normality 
Implicit in the Analysis of Variance.” Journal of the American StatiMical Asaociationt 
Vol. 32 (1937), pp. 676-702. 

® Census of Partial Employment, Unemployment, and Occupations 1937, Volume 
IV, The Enumerative Check Census, by Calvert L. Dedrick and Morris H. Hansen, 
U. S. Govt. Printing Office, Washington, 1938. 

’ For a textbook exposition of the application of Fisher’s methods to analysis 
of social and economic data, see Margaret Jarman Hagood, Statistics for Sociologists, 
New York, Henry Holt and Company, 1941, pp. 641-592 and 679-716. 
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to the central field of sociological research, however, will be further ad¬ 
vances in the application of the Fisher methods of analysis to the com¬ 
plex systems of interrelated social and economic variables. 


Resume 

La th6orie de plans d’exp^riences, comme elle a ete developp6e par R. 
A. Fisher, a ete mlse en pratique beaucoup moins dans les sciences 
sociales que dans les sciences naturelles. Cela est du principalement It 
ce que les phenomfenes en question ne se pretent ordinairement pas It 
Texp^rimentation. L’experimentation est possible, toutefois, en cer¬ 
tains domaines de la recherche sociologique et ceux-ci constituent un 
terrain potentiel pour Tapplication des methodes de Fisher. 

Aux Etats-Unis, les psychologues en mati^re d’education sont plus 
avanc6s que les specialistes en d’autres domaines des sciences sociales 
quant k Temploi des methodes de Fisher. Un releve fait recemment sur 
les etudes exp6rimentales en Education montrent que, dans la moiti^ 
des cas, les methodes de Fisher etaient employees. Puisque quelques- 
unes de ces etudes s’occupent de problemes semblables k ceux qui con- 
cernent les sociologues, elles pourraient bien servir comme guides pour 
entreprendre des etudes exp^rimentales dans le domaine sociologique. 

Les methodes de Fisher ouvrent le plus de perspectives dans le 
domaine des sciences sociales quand il s’agit d’analyser des donnees non 
obtenues par voie d’experimentation. La premiere etude aux Etats-Unis 
traitant de cette fa 9 on d’employer les methodes de Fisher a ete publi^e 
il y a dix ans. Les exemples se sont multiplies recemment et Ton peut 
s’attendre k ce qu’ils augmentent encore. 
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Discussion 

Mr. Mahalanobis discussed an adaptation of the Fisherian design 
which has been used extensively in India since 1940, for small-scale 
surveys. 

Mr. Yates mentioned a housing survey which is underway in 
England, and described the design of the experiment which is to find 
out the reaction of the people who live in the houses to various types of 
housing conditions. He added a few remarks on the wartime develop¬ 
ment of the factorial design for agricultural experimentation, and on re¬ 
cent improvements in animal husbandry experiments. 

Mr. Eisenhart referred to the work of the late Leonard Salter, 
consisting of a critique of research methods in the social sciences. Salter 
felt that the influence of Karl Pearson’s Graynmar of Science had 
ended to overemphasize description as against clearly stated objectives, 
description for its own sake in contrast to interpretation of data as a basis 
for action. 

Mr. B a t e n and Miss H a g o o d also participated in the discussion 
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RAPPORT SUR L’ACTIVITE DE LA COMMISSION 
MIXTE DE STATISTIOUE CRIMINELLE 

par Alessandro A. Molinari 

Directeur QirUral de VInaiitut Central de Statiatique (Italie) 

1. En 1931, h Madrid h, Toccasion de la vingtifeme session, TAssemblee 
de notre Institut approuva (stance du 16 septembre) la constitution 
d’une Commission mixte entre la Commission Internationale Penale 
et P6nitentiaire (C.P.P) de Berne et Tlnstitut International de Statis- 
tique (I.I.S), “pour contribuer a la preparation de recherehes de statis- 
tique criminelle internationale’\^ 

* A la suite d’une communication de M. J.Jt. B. de R o o s (“Consonnes et voyel- 
les”—Communication sur la Statiatique Criminelle) k la XVIIerne session du Cairo 
(1927), rinstitut International de Statiatique avait institu6, dans sdn sein, une 
‘^Commission pour T^tude comparative des statistiques criminelles dans les divers 
pays.” (Membres: M. F. F a u r e. Prof. C. G i n i, Prof. M. Greenwood, 
Dr. J. R. B. de B o o s, rapporteur, et Dr. E. W ii r z b u r g e r.) Le premier 
rapport de la Commission fut pr^sent^ par M. de Roos k la XVIIIeme session deVar- 
sovie (1929) oti il fut d6cid4 de continuer les etudes sur la base des recommandations 
et des observations du rapporteur. 

L*ann6e suivante le Xeme Congres International p6nal et p6nitentiaire (Prague, 
1930) vota une resolution qui exprimait la possibilite et le d^sir de “realiser une co¬ 
operation intemationale en vue d’organiser I’etude scientifique, par des methodes 
uniformes, des causes des fluctuations de la criminalite.” 

M. de Roos jugea alors opportun de s’ckdresser k la Commission Internationale 
penale et penitentiaire pour parvenir k \me collaboration entre les deux institutions 
intemationales dans le but de chercher k eviter un double emploi et d’obtenir une 
plus grande uniformity dans le domains des statistiques criminelles intemationales. 
Les dymarches faites aboutirent k la cryation de la Commission mixte mentioiihye 
dans le texte. 
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Depuis lors la Commission mixte s’est r6unie trois fois: k Leipzig (24 
novembre 1932), k Paris (27 et 28 janvier 1936), k Berlin (18 et 19 avril 
1939). La guerre a interrompu les travaux qu’il s’agirait maintenant 
de continuer. Avant de prendre une decision k ce sujet il parait n6- 
cessaire de r6capituler le travail accompli par la Commission. 

2. Dans la premifere r6union de Leipzig^ la Commission mixte, 
apr^s avoir enum6re les difficultes qui font obstacle k une comparaison 
internationale des statistiques criminelles, fixa comme suit son pro¬ 
gramme de travail: 

a) Preparation d’un schema g6n6ral uniforme d’“introduction”— 
dans une langue d’usage international—qui devrait accompagner les 
publications nationales de statistique criminelle afin de les rendre com- 
prehensibles aux peraonnes interessees de tous les pays. 

b) Preparation d’un schema des elements qui devraient, de prefe¬ 
rence, etre rassembles pour dresser les statistiques criminelles de chaque 
pays et le mode de leur publication. Dans ce but il est n^cessaire de 
prendre connaissance des formulaires utilises dans les divers pays pour 
recueillir les donnees fondamentales. 

c) Etudes concernant la possibilite d’instituer une enquete inter¬ 
nationale dans un domaine special nettement determine, du droit positif. 
Dans ce but la Commission internationale penale et penitentiaire devrait 
arreter une definition internationale de I’infraction destinee k former 
I’objet de I’enquete.^ (On envisagea: les infractions contre les moeurs 
dans lesquelles I’instinct sexuel joue un role; les delits de faillite ou 
de banqueroute; les crimes de fausse monnaie). Cette raethode implique 
pour une grande partie des cas, la consultation des pieces des proces afin 
de pouvoir constater si I’acte punissable tombe sous la definition de I’in- 
fraction telle qu’elle a 6t6 arretee par la Commission mixte. 

M. E. Schafer fut charge de preparer un projet au sujet de deux 
questions envisagees aux points (a) et (b). M. le Comte Gleispach 
se chargea d’elaborer des projets en vue de Tenquete envisag6e au 
point (c). 

> Ont particip6 cette r6union, comme representants de la C.P.P.: M. le 
Comte W. Gleispach ot le Dr. E. Schafer; comme representants de I’l.I.S.: MM. le 
Prof. G. Mortara, le Dr. J. R. B. de Roos, et le Dr. Wurzburger. Etaient 6galement 
presents: MM. N.L.J. van Buttingha Wichers, sous-Directeur de TOffice Perma¬ 
nent de ri.I.S. et le Dr. E. Roesner du Statiatiachea Reichaamt, 

* Cette id6e se rattache aux propositions des MM. C. Gini et A. Spallanzani 
pr4sent6es k la session de Madrid en 1931 dans la communication ayant pour titre 
*^Sulla comparazione dei dati di atatistica criminate dei diverai StatV' (Sup la compara¬ 
bility des donnees do statistique criminelle des divers Etats). Les auteurs proposaient 
d’ytablir ex novo la dyfinition juridique d’un certain nombre de dyiits de fa^on k 
pouvoir en d^duire, avec des mythodes statistiques imiformes, dee eyries de contenu 
. identiqua, 
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De la discussion il ressortit clairement quo le programme pr6par6 par 
la Commission mixte visant les points (a) et (b) ne constituait qu’un 
premier pas dans la voie d’une comparability internationale, c’est-4-dire 
un travail prelimivxiire indispensable pour le dyveloppement ulterieur 
des ytudes. Dans cette premiere phase du travail, la Commission mixte 
a ycarty intentionnellement la question de la comparability internationale 
des statistiques criminelles telles qu’elles viennent d’etre publiyes 
par les divers pays, non seulement en ce qui concerne Vetat de la crimi¬ 
nality—dont la comparability a yte jugee presque impossible k ryaliser 
—^mais ygalement le mouvement de la criminality. 

La premiere tache de la Commission mixte se borne done k ryaliser 
une meilleure compryhension des statistiques criminelles des divers pays, 
et, par consyquent, k ryunir tons les yiyments nycessaires pour etre k 
meme de juger du degry de leur comparability internationale ou par 
groupe de pays (zones de bonne ou de mauvaise comparability, etc.)^ 

3. Dans la ryunion de Paris (Janvier 1936) la Commission mixte® 
prit en examen le projet de T“introduction” et le “schyma-type” des 
cadres statistiques, pryparys par M. E. Schafer.® 

La question concernant Tenquete internationale sur un dyiit dyter- 
miny fut provisoirement ajournye. 

Sur la base des discussions faites k Paris et des observations succes- 
sives des membres de la Commission mixte, M. Schafer presenta, au nom 
de la Commission, un rapport k la XXIIiyme session d’Athenes 
(septembre—octobre 1936) ayant pour titre: “Directives pour I’elabora- 
tion des statistiques criminelles dans divers pays.”"' 

L’Assembiye de I’lnstitut (syance piyniere du ler octobre) adopta les 
directives recommandyes par la Commission.'^ 


* Les pays nordiques (Su^de, Danemark, Norvege, Finlande) seraient A mAme 
d*appliquer les recommandations adoptAes par I’lnstitut en 1936. Cela resulte de 
I’Atude publi6e dans la Revue de I’lnstitut International de Statistique (lie annAe, 
livraison 3/4, 1943: “La statistique criminolle et pAnitentiaire des pays nordiques,** 
par le Dr. B. J. Hoijer, directeur en chef du Bureau central de Statistique, Stock* 
holm, et par le Dr. Otto Gronlund, Chef du Bureau, Stockholm). 

* Ont participA A cette rAunion oomme repr6sentants de la C.P.P.: MM. A, 
MossA, H. Nissen; le Dr. E. Schafer; comme repr6sentants de TI.I.S.: MM. le Dr, 
A. Molinari, le Dr. H. Truchy, le Dr. E. Wurzburger. Etaient Agalement prAsents: 
le Prof. J. Simon van der Aa, secrAtalre gAnAral de la C.P.P. et M. N. L. j. van But* 
tingha Wichers, sous-directeur de TOfflee Permanent de I’l.I.S. 

* Bn 1934 et 1935 les membres de la Commission mixte avaient examinA le pre¬ 
mier projet du MAmoire prAparA par le Dr. SchAfer et lui avaient fait parvenir leurs 
observations qui furent, en mAme temps, portAes A la connaissance de tous les mem¬ 
bres de la Commission mixte. 

» Le rapport a paru en fran^ais dans le Bulletin de 1*1.1. S.—^Tome XXIX 
3Ame livraison (pages 240 A 251). Dans le mAme Bulletin, Tome XXIX, lere livrai¬ 
son, ont AtA reproduits (en anglais, en fran(?ais, et en allemand): le plan pour une 
introduction gAnArale A la statistique oriminelle et le sohAma-type des cadres statis- 
tiques (pages .6)A227 
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4. A cause de la guerre les d6cision8 approuv^es par la Commission 
mixte et par les deux organisations internationales int6ressees, n’ont 
pu avoir une suite pratique. L’Office Permanent de TI.T.S devrait, 
par consequent, s’adresser de nouveau—si possible avant la fin de 1947 
—aux bureaux de statistique des divers pays qui s’occupent des statistic 
que criminelles, pour les prier; (a) de faire prec^der les publications de 
statistique criminelle d’une “Indroduction” conforme h celle qui a 
ete approuvee par la C.P.P. et TI.I.S.; (b) de depouiller les statisti- 
ques de la criminalite suivant le sch6ma-type des cadres statistiques, ega- 
lement approuve par la C.P.P. et TI.I.S. ou, tout au moins, de faire en 
sorte que les statistiques Rationales puissent etre facilement ramenees 
aux cadres statistiques dont il est question. 

5. A la suite des accords qui ont eu, lieu en 1938 entre la C.P.P. et 
ri.I.S., il fut decide de traiter k la reunion de Berlin® les questions 
suivantes: 

a) statistique internationale des meurtres 

b) statistique internationale p6nitentiaire 

La question sous (a) rentrait dans le programme de travail de la 
Commission mixte (c’est-a-dire “rinstitution d’enquetes internationales 
dans un domaine special nettement d6termin6 du droit positif*': voir 
paragraphs 2) qui avait et6 provisoirement ajourn6 k Paris. Bien que 
le meurtre ne figurait pas parmi les infractions qui, d’aprfes les decisions 
prises k Leipzig, devraient etre choisies pour Tenquete internationale 
envisages, il ne fait aucun doute que Thomicide est un des delits sur 
lequel d’eminents statisticiens et criminalistes ont insists davantage, 
pendant trois quarts de siccle, pour en faire Tobjet principal de statis¬ 
tiques internationales comparables, tout au moins pour ce qui concerne 
le “mouvement” dans le cours du temps. 

La question sous (b) suggeree par la C.P.P., represente une addition 
importante au programme original de la Commission mixte. 

6. Pour ce qui concerne la statistique internationale des meurtres^ une 
6tude tres approfondie du Dr. Roesner sur la statistique internationale 
des homicides fut soumise k la Commission.® Cette etude renfermait 

* Ont participe k cette reunion, comme repr^sentants de la C.P.P.: MM. le 
Dr. Nissen et le Dr. Schafer; comme repr6sentant8 de 1*1.1.S.: MM. A. Molinari et 
le Dr. Reichardt, president du Statiatisches Reichsamt, Etaient 6galement pre¬ 
sents, et ont pris une part active a la discussion: MM. le Dr. Roesner, du Statia^ 
tiachea Reichaamt; Ernest Delaquis, secr6taire g^n^ral de la C.P.P., et van Buttingha 
Wichers, sous-Directeur de TOffice Permanent de TI.I.S. (avril 1939) 

* Dr. Ernst Roesner, '^Internationale Mordatatiatik —Vorachlage zur Metkode 
und Technik^' (Statistique internationale des homicides—Propositions de m^tho- 
de et de technique). Monataachrift fur Krirninalhiologie und Strafrechta Reform 
(Revue mensuelle de biologie criminelle et de la r^forme du droit p^nal) 1939, Heft 
S, J. F. Lehmanns, MUnoh^m-Berlin) 
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proposition^ pratiques sur la m6thode 4 suivre pour le relev6 et 
renregistrement des donn^es statistiques, leur depouillement et leur 
classification. II fut egalement soumis aux membres de la Commission 
mixte, un projet de formulaire, trfes d6taill6, pour Fenquete statistique 
speciale sur le meurtre. 

En raison du manque de precision des notions juridiques au sujet 
de rhomicide, la Commission, unanime, proposa, d’abord, de limiter 
Fob jet de Fenquete Internationale aux debts d’homicide intentionnels 
(4 Fexception de Finfanticide). 

Le plan de travail envisage par la Commission peut etre resum6 comme 
suit: 

a) le Bureau permanent de la C.P.P. demandera aux autoriti^s judici- 
aires des divers pays un relev4 des dispositions en vigueur sur les debts 
d’homicide intentionnel et un resume statistique des condamnes par 
Jugement definitif au cours des cinq dernieres ann^es. 

b) la Commission mixte, en tenant compte des r^sultats de Fenquete 
mentionnee sous (a) fixera la notion de “d^bts d’homicide intentionnels.” 

c) ensuite FOffice Permanent de FI.I.S. recommandera aux divers 
pays d’efFectuer des enquetes statistiques sur les debts d’homicide inten¬ 
tionnels (selon la definition mentionnee sous (b)), en utibsant a cct effet 
les actes judiciaires. Les donnees et les informations 4 fournir seront 
enregistrees dans un formulaire dont le schema definitif devra etre pre¬ 
pare par la Commission mixte. 

d) les resultats de Fenquete seront examines et depouilies par la 
Commission mixte. 

Si la vingt-cinquieme session de notre Institut est d’accord on pourra 

dej4 passer sans autre deiai 4 Fexeoution de la proposition indiquee 
sous (a). 

^ Le texte des decisions de la Commission mixte est reproduit dans 
r Annexe. 

7. A I’egard de la statistique internationale penitentiaire le Dr, 
Reichardt soumit 4 la Commission mixte un rapport et des docu¬ 
ments qui formerent la base des discussions.^® 

*0 Le rapport du Dr. Reichardt, “Observations et suggestions pour la r4solu- 
tion du probleme de la statistique internationale des Prisons” {Bemerkungen und 
Anregungen zur Loaung dea Problems der Internationalen Gefangnisatatistik) 6tait 
compl6t4 par trois annexes:. 

1) bibliographie des congres internationaux qui ont traits des questions de sta¬ 
tistique penitentiaire; 

2) bibliographie sur le probleme de la statistique internationale des prisons: 

3) projet de questionnaire propose par M. D’Orelli au Congres Penitentiaire In-, 
ternational de Stockholm en 1878. 

Furent aussi distribues deux memoires du Dr. Roesner (publies en 1937); “Bi6Ko, 
gropAie der Strafvollzugaatatiatik dea In- und Aualandea" et “Die Oefangenen der Welt 
%n Zahlen,** Les donnees qui figuraient dans cette derniere etude ont ete tirees, 
d® la puWication “TAs Prisoner PopMio<iono/«Ae TTqrW” (Septemfira 
1936) presentee par la Hotoclfd Ijeogue of Penal Ptforffi%^ 
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'Les resolutions adoptees par la Commission mixte sont reproduites 
dans YAnnexe, 

8. La reunion de Berlin a deblaye le terrain d’un grand nombre 
de questions d'ordre general soulevees par les deux problfemes envisages. 
La Commission mixte non seulement est tombee d’accord sur la reso¬ 
lution de questions statistiques fondamentales, mais elle a aussi indique 
clairement la voie pratique k suivre pour atteindre des resultats concrets 
et conclusifs. Toutefois il reste un grand travail accomplir. 

9. Par suite de la perte douloureuse de la plupart des eminents col¬ 
logues qui faisaient partie de la Commission mixte, il serait nOcessaire 
de la reconstituer, de sorte que leurs travaux, si fructueux et interessants, 
puissent continuer. A mon avis la nouvelle Commission devrait borner 
son activite aux questions fondamentales et essentielles qui figurent 
dans le programme de travail et faire tous les efforts pour mener k bonne 
fin les resolutions adoptOes dans les trois reunions d’avant-guerre. Un 
changement de programme ou, k plus forte raison, son elargissement, 
ne pourraient, k mon avis que nuire aux progres, dejO» si lents k realiser, 
dans le domaine des statistiques internationales de la criminalite. 

En consequence je me permets de proposer que la 250me session de 
rinstitut International de Statistique exprime les voeux suivants: 

1) que la Commission mixte de statistique criminelle soit reconstituee 
et continue ses travaux sur la base des resolutions adoptees dans les 
trois reunions d’avant guerre, tout en tenant compte des modifications 
eventuelles suggerees par la nouvelle situation de I’organisation statis¬ 
tique internationale. 

2) que les Offices Permanents de la Commission Internationale 
Penale et Penitentiaire et de Tlnstitut Internationale de Statistique, 
donnent execution au plus tot et autant que possible, aux enquetes 
de leur ressort, suivant les decisions adoptees avant la guerre. (Voir 
paragraphe 4 et point (a) du paragraphe 6 du present rapport). 


Annexe ^ 

Resolutions adoptees par la Commission mixte pour la Statistique 

criminelle 

(Reunion de Berlin, 18 et 19 avril, 1939) 

I. Statistique internationale des meurtres 
A. Resolutions: 

1. Pour poursuivre la t&che qui lui a 6t6 confine de favoriser la co¬ 
operation internationale dans le domaine de la statistique criminelle; 
la Commission mixte estime desirable que soit entreprise une enquSte 



464 


INTEBNATIONAL StATISTIOAL COBFSBSNOBS: I 0 1 


statistique intemationale, au point de vue psyohologique et sooiologlque, 
des d^lits d’homicide intentionnels. 

2. La condition pr^liminaire du succfes de I’enquete mentionn^e 
sous (1) est une delimitation exacte de la notion ''deiits d’homicide in- 
tentionnels.*' 

3. En consequence, le Bureau permanent de la Commission inter- 
nationale penale et penitentiaire est prie de demander aux autorit6s 
judiciaires superieures des divers pays de lui faire parvenir le rele^e des 
dispositions en vigueur dans leur pays sur les deiits d’homicide inten* 
tionnels ainsi qu’un resume statistique du nombre des individus con- 
damnes par jugement definitif pour ces deiits, au cours des cinq derniferes 
annees. Le Bureau permanent formulera cette requete de concert 
avec deux membres de la Commission mixte, a savoir MM. Schafer et 
Reichardt.^^ La documentation recueillie k la suite de cette enquete 
sera examinee par les memes membres de la Commission mixte et soumise 
k la Commission. 

B. Recomniandations: 

Pour la suite des travaux, la Commission recommande la procedure 
suivante: ^ 

La Commission mixte fixera trfes nettement, au cours d’une nouvelle 
reunion qui devra avoir lieu le plus tot possible, la notion des ‘‘deiits 
d’homicide intentionnels,” notion qui sera determinante pour I’enquete 
statistique mentionnee sous A/1. 

Ensuite, I’Office Permanent de I’lnstitut International de Statistique 
recommandera aux divers pays d’effectuer, pour des periodes determi- 
nees, des enquetes statistiques sur les deiits d’homicide intentionnels 
dans le sens ci-dessus, en utilisant les actes judiciaires se rapportant k 
des cas juges definitivement, selon le sch6ma qui figure dans le formu- 
laire annexe au proems-verbal auquel la Commission mixte se reserve de 
donner une redaction definitive lors de sa prochaine reunion. Les sta- 
tisticiens charges d’6tablir la statistique criminelle dans les Offices de 
statistique de chaque^pays utiliseront les actes judiciaires et rempUront 
les formulaires d’une mani^re uniforme, afin d’assurer I’homog^n^itd et 
la technicit6 du travail. 

Les formulaires dfiment remplis devront etre transmis par les divers 
pays k la Commission mixte par I’interm^diaire de I’Office Permanent de 
rinstitut International de Statistique. La Commission mixte pro- 
c^dera l’appr6ciation statistique des donn6es contenues dans les formu¬ 
laires et k la presentation numerique, sous forme de tableaux, des r^sul- 
tats de renqudte. 

“ Malheureusement nos deux ^minents collogues sont deoedes* 
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II. Statistique pinitentiaire iniernationale 

1. La Commission mixte estime desirable que, dans chaque pays, une 
statistique pouvant servir k la comparaison internationale soit tenue: 

a) sur les etahlissements dans lesquels des peines privatives de li¬ 
berty sont purgees. 

b) sur les occupants de ces 6tablissements, pour autant qu’ils purgent 
des peines privatives de liberty ou sont astrcints h des mesures de stiret6 
comportant privation de libert6. 

La Commission mixte se reserve de delimiter avec precision les 6ta- 
blissements et les occupants entrant en ligne de compte et de designer 
les conditions particuliferes des etablissements et de leurs occupants sur 
lesquelles doit porter la statistique. 

2. La Commission mixte r6sumera ses propositions sur la statistique 
d^siree dans un schema-type. 

3. Pour la preparation de ce schepaa-type, les pays seront requis de 
mettre la disposition de la Commission mixte les instructions et for- 
mulaires en usage pour le rassemblement statistique des donnees en ques¬ 
tion. Le Bureau Permanent* de la Commission Internationale Penale 
et P6nitentiaire est prie d’adresser un appel dans ce but aux autorites 
penitentiaires des divers pays et d'exprimer en meme temps le desir de 
recevoir la publication la plus recente se rapportant a cette statistique. 

4. Apr6s avoir ete approuve par les deux organisations, le schema- 
type devra etre envoye k tons les pays avec la recommandation d’y 
adapter leurs statistiques en question et de le faire preceder d’une 
introduction qui, sous certains points de vue, initie au domaine dont 
il s’agit et rende la statistique mieux compr^shensible pour Tusage 
international. 


R68um4 

1. The work accomplished, from 1931 to 1939, by the joint Commis- 
sion on Criiliinal Statistics formed by the International Penal and 
and Penitentiary Commission of Berne and the International Statistical 
Institute is summarized here. 

2. Program 

(a) Preparation of a uniform general scheme of “introduction,” in 
an internationally spoken language, which should accompany national 
publications of criminal statistics to make them understood by interested 
persons in every country. 

(b) Preparation of an outline of desirable data to be collected for com 
piling the criminal statistics of each country, and an outline of methods 
of publication. 

69 
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(o) Study of the possibility of making an international investigation 
in some special, clearly defined, legitl field. Fot this putpose the Com¬ 
mission decided to limit the international investigation to'the field of 
murders (crimes of willful homicide, excluding infanticides). 

(d) Preparation of guides for the compilation of international prison 
statistics. 

3. Carrying out the program. The situation is as follows: 

(a) As far as points (a) and (b) of the program are concerned, the 
Joint Commission has discharged its task by presenting, at the Athens 
Session (September-October 1936), a report that was approved by the 
Assembly. 

(b) Concerning point (c) of the program, the Joint Commission estab¬ 
lished the theoretical and practical principles that should guide inter¬ 
national inquiry on murders. 

The Joint Commission was then to have concerned itself with estab¬ 
lishing an exact definition of “crimes of willful homicide.'* To arrive at 
such a definition, it was recognized that it was first necessary to collect: 
(1) The regulations in force in the different countries concerning willful 
homicides; (2) a statistical summary of the number of individuals con¬ 
victed by final judgment for such homicides. An investigation of this 
kind was to have been made by the Permanent Office of the International 
Penal and Penitentiary Commission, in agreement with the Joint Com¬ 
mission. 

A first draft of subsequent tasks was outlined in the resolutions adop¬ 
ted (Juring the 1939 Berlin Session (see appendix to report). 

(c) With respect to point (d) of the program, the Joint Commission 
limited itself to making a preliminary, but intensive, study of the ques¬ 
tion. This study has enabled the Commission to agree on the objective 
of the investigation and on the statistical units to be considered. 

(d) The Commission also prepared the agenda of future proceedings 
(see appendix to report), 

4. In consideration of the aforesaid, the writer proposes that the 
twenty-fifth Session of the International Statistical Institute agree on 
the following draft resolutions: 

(1) that the Joint Commission on Criminal Statistics be reconstituted 
and continue its work on the basis of the resolutions adopted in the three 
prewar meetings, with due regard to changes, if any, brought about by 
the new situation in international statistical organization. 

(2) that the Permanent Offices of the International Penal and Peni¬ 
tentiary Commission and of the International Statistical Institute carry 
out, as soon and as completely as possible, the investigations in their 
fields which were required by the action taken before the war. 
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Discussion 

Mr. Idenburg reported that the United Nations Secretariat had 
recently distributed a questionnaire concerning criminal statistics, and 
therefore proposed that the draft resolutions proposed by Mr. Molinari 
be amended to read as follows: 

“(1) that the Bureau consult with the Secretary-General of the 
United Nations Social Affairs Department about the work undertaken 
by the United Nations in the field of criminal statistics. 

‘ ‘ (2) that if after this consultation it appears useful, the Joint Commis¬ 
sion on Criminal Statistics be reconstituted and continue its work on 
the basis of the resolutions adopted in the three prewar meetings, with 
due regard to changes brought about by the new situation in international 
statistical organization. 

‘‘ (3) that the Permanent Office of the International Penal and Peniten¬ 
tiary Commission and of the International Statistical Institute carry 
out, as soon and as completely as possible, the investigations in their 
fields which were required by the action taken before the war.'* 

The amendment was approved. 



METHODS OF THE STATISTICS OF 
SOCIAL INSURANCE 

by Demetrious Calltsounakis 

Graduate School of Economic and Commercial Science, Athens {Greece) 

An independent and separate system of social statistics does not yet 
exist. To establish such a system is very difficult for various reasons. 
The age group composition of a population, the great number of various 
economic classes into which it is divided, and moral and psychological 
factors prevent the objective and systematic study of a society from the 
statistical point of view. We are, however, going to maintain a system 
of social statistics as it is done everywhere else. The difficulties of such 
an attempt can be seen in the small progress so far achieved in the field 
of international comparison of labor accidents, through the joint efforts 
of the International Statistical Institute, of the International Labor 
Office, and of the previous Conferences for Social Insurance; although 
from the methodological point of view, many things have been clarified. 

I shall try to present systematically the statistical data of social insu¬ 
rance in three main statistical fields. Insurance against illness and 
maternity belongs to the so-called biological statistics of population. 
Here, the statistical data should be classified according to the causes of 
illness. The insurance of maternity should be classified under the sta¬ 
tistics of births. 

The most important statistics of social insurance are undoubtedly the 
statistics of accidents. The International Statistical Institute dealt 
with this subject at its Tenth Session in London. The International 
Statistical Conference in Paris (1889) as well as that held in Berne (1891) 
discussed the same subject.^ The main object of this kind of social 
insurance is the promotion of means for the prevention of and insurance 
against accidents, with the use of statistical data. Unfortunately, there 
are many difficulties hindering the realization of this object because 
international standardization depends especially on national legislation 
defining accidents and insurance methods. Because of this, the Inter¬ 
national Conference of Labor Statisticians (1923) dealt in general with 
certain definitions such as those of the nature and time of accidents, 
their causes, their damages, and their compensations. 

Here we have to work hard and continuously to arrive at definite re¬ 
sults. We can deal especially with labor accidents in three industrial 
branches, that is to say, in mining, mercantile marine, and railways. 

* A good summary' of the work dona and of the present state of affairs is given 
by J. Feig, in the Proceedings of the Eighth Session of the International Statistical 
Institute, Warsaw (1928). 
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All these statistics of labor accidents^ belong to socio-political statis¬ 
tics and, in a broader sense, to economic statistics. 

Insurance against old age and for persons dependent on the aged, 
belongs to the statistics of civilization, or rather to positive moral statis¬ 
tics. The effect of such insurance is so beneficial that from its nature 
it must be treated under the above heading. 

Finally, we have to deal with unemployment statistics, which belong 
in labor statistics or in the socio-political category. Useful comparison 
of the results® of this kind of insurance depends on the system of unem¬ 
ployment payments as well as on the international definition of unem 
ployment. We must confess that in this field great progress has been 
made, as can be seen in the following figures: the number of persons in¬ 
sured against unemployment increased from 5 millions in 1919 to 42 
millions in 1934. In addition, the International Labor Office has been 
able to draft an index number of unemployment in the main countries. 

On the above basis, I shall take the liberty of submitting the following 
proposal for consideration: 

The permanent office of the International Statistical Institute is au¬ 
thorized to notify the most important countries of a classification con¬ 
taining systematically all fields of social statistics, and to ascertain 
whether they are inclined to accept this classification. In this way, 
it is hoped that comparable statistical data on social insurance can be 
obtained from the principal countries. 


R^sum^ 

II est neoessaire de proceder k une modification systematique uni- 
forme des statistiques des assurances sociales dans les divers pays. 

Une paroille revision interesserait surtout: (1) les statistiques de- 
Tassurance-maladie et de la maternit6; (2) les statistiques des accidents 
(causes, dogr6s, dur6e, indemnit^s); et (3) les statistiques du chdmage, 
domaine dans lequel des progr&s internationaux ont d^j^t et6 realises. 
II strait done utile que TOffice permanent de ITnstitut International 
de Statistique communique aux principaux pays un repport traitant 
d’une mani^re systematique au moins les domaines ci-dessus mentionn^s 
de la statistique des assurances sociales et s’assure si ces pays sont dis¬ 
poses k 1'adopter. 

* For the classification of labor accidents see “La Standardisation Internationale 
des Statistiques du Travail”, Bureau International du Travail, Geneve, 1934. 

» The International Labor Office published in 1922 an essay on the methods of 
unemployment statistics, and in 1932 a summary of the results of the International 
Conferences on Labor Statistics, 
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Discussion 

Miss Bodmer discussed briefly the work of the International Labor 
Office in the field of social insurance statistics: 

“The Sixth International Conference of Labor Statisticians met in 
Montreal in August 1947, and adopted a resolution on the statistics of 
industrial accidents, including a definition of industrial accidents for 
statistical purposes and a standard method of computing frequency and 
severity rates. The subject of classification of accident causes, which 
at present is undergoing extensive experimentation in certain countries, 
has been proposed for consideration at a subsequent session of the Inter¬ 
national Conference of Labor Statisticians. 

“...The Sixth International Conference dealt also with the subject of 
unemployment statistics and made important recommendations in this 
field. The Year Book of Labor Statistics publishes the available statis¬ 
tics on unemployment for'tho different countries of the world. 

“...Under the auspices of the International Labor Office, the Medical 
and Statistical Technical Commissions of the Inter-American Committee 
on Social Security, meeting in Washington in January 1947, discussed 
the standardization of medical care statistics and morbidity statistics 
of social insurance institutions... The Joint Commissions adopted con¬ 
clusions for submission to the Second session of the Inter-American Con¬ 
ference on Social Security, to be held at Rio do Janeiro in November 
1947... 

“The resolutions on the standardization of medical care statistics pro¬ 
vide for the publication of such data as: the number of medical care ser¬ 
vice establishments—hospitals and out-patient clinics, of the medical 
staff employed by or working for the medical care service, the number 
of persons receiving care, and the items of care furnished by the service, 
as well as the cases and duration of hospitalization. 

“As regards morbidity statistics, the resolutions adopted by the Tech¬ 
nical Commissions of the Inter-American Social Security Committee lay 
down the minimum data that should be provided by social insurance 
institutions, such as cases of illness and cases of incapacitating illness, days 
of incapacitating illness, and the number of persons exposed to risk; the de¬ 
finition of these units, and their classification by age, sex, and disease.... 

“It is intended to further extend the work of the Social Insurance Sec¬ 
tion of the International Labor Office by the standardization and publi¬ 
cation of statistics on the actuarial experience as well as the adminis¬ 
trative aspects of social insurance institutions.” 

Mr. Idenburg suggested and participants in the meeting agreed, 
that Mr. Calitsounakisbe asked to work out his ideas on the 
classification of statistics of society, before the International Statistical 
Institute should undertake work in this field. 



ORIGIN, FUNCTIONS. AND FUTURE OF THE 
BRITISH CENTRAL STATISTICAL OFFICE 

by Ernest H. Godfrey 
Fellowt Royal Statistical Society {Great Britain) 

The establishment of a Central Statistical Office by the British Govern¬ 
ment is an event which the International Statistical Institute will 
note with interest, because its publications should facilitate interna¬ 
tional comparisons, which ic is the object of the Institute to promote. 

What follows is an attempt to describe briefly previous efforts made 
by statisticians, and especially by Fellows of the Royal Statistical 
Society, to promote the formation of a Central Statistical Office for 
Great Britain, the functions which it is designed to fulfill and the lines 
upon which it may be expected to proceed in future. 

Past Efforts towards Statistical Reforh 

The movement that has culminated in the establishment of a British 
Central Statistical Office gees back for about 76 years. One of the 
earliest efforts towards statistical reform was made by Frederick 
Purdy, who was Principal of the Statistical Department of the Poor 
Law Board and an Honorary Secretary of the Statistical Society. In 
a paper read before the Society on March 21, 1871, he described numer¬ 
ous defects in the situation then existing, recommendad the establish- 
men tof a department that should be intermediary between Parliament 
and the various Government Offices (in other words a Central Statistical 
Office) and laid down under eight headings the principal duties which 
such a department should have. 

According to Sir Hubert Llewellyn S m i t h’s book on the Board 
of Trade (1928), regular systematic statistics, as issued by the Board of 
Trade, date from 1832, when G. R. Porter, afterwards famous as 
author of the Progress of Nations, entered the Board’s service. He 
organized the Stai/iitical Department of the Board of Trade, and issued 
a kind of Statistical Year Book under the title Tables of the Revenite, 
Population, Commerce, etc,, of the United Kingdom and its Dependencies. 
This volume appeared annually from 1832 to 1854, and from it were de¬ 
rived many of the later statistical publications of the Board of Trade, 
including various annual Statistical Abstracts. Among these may be 
mentioned that for the United Kingdom from 1854; for the Colonies 
and Possessions from 1864, later under the changed title, Statistical Abs- 
tract for the Several Oversea Dominions and Protectorates) for the British 
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Empire from 1905; for Labor Statistics of the United Kingdom from 1894; 
and for Foreign Labor Statistics from 1899. But the two Great Wars 
of 1914-1918 and 1939-1945 involved of course the permanent or tem¬ 
porary suspension of these publications. 

Sir Robert G i f f e n, who was appointed head of the Statistical De¬ 
partment of the Board of Trade in 1876, and who acquired high repu¬ 
tation as a statistician, was, as stated by Sir Hubert Llewellyn Smith, 
a “strong advocate for centralization, not only within the Board of Trade, 
but also (at least in principle) within the Government Service generally. 
He sympathized with the idea of constituting a Central Statistical 
Department to serve the requirements of all the Departments of 
State.’* 

On March 28^ 1877, an Official Statistics Committee was appointed 
by the British Treasury. This Committee took evidence from numerous 
witnesses from March 26,1878, to August 6,1879, and the Minutes of the 
Evidence, together with a number of Appendices, were printed and pub- 
lii^hed. Three Reports were presented by this Committee, the first, 
dated August 6, 1879, having reference to the Customs and the second, 
of the same date, to the statistical returns of the Local Government Au¬ 
thorities. The third Report, dated December 23, 1879, and published 
in 1881, dealt more generally with the subject under two sections: (1) 
principles for the revision of existing official statistics, and (2) recommen¬ 
dations for the future conduct and control of official statistics. They 
made various recommendations, including the appointment (a) of a small 
Central Statistical Department subordinate to the Treasury and (b) of 
a Board or Commission to supervise official statistics. The Treasury 
accepted recommendation (b), and decided to set up a Statistical In¬ 
quiry Committee. 

In his presidential address to the Royal Statistical Society on Novem¬ 
ber 19, 1907, Sir Charles D i 1 k e described defects in the existing offi¬ 
cial statistics and referred favorably to proposals previously made for 
the establishment of a Central Statistical Office; and on June 16, 1908, 
Mr. Arthur B o w 1 e y, subsequently Professor of Statistics in the Uni¬ 
versity of London, read a paper before the Society bn the Improvement 
of Official Statistics and discussed the lines upon which a “Central Think¬ 
ing Office of Statistics” should be set up, or a Central Statistical Depart¬ 
ment, which he had advocated on various occasions and especially in 
his address to a Section of the British Association in 1906. 

In an article in the Financial Review of Reviews of January, 1911, 
entitled “Our Statistics: A Plea for a Central Government Department,” 
Sir Athelstane Baines, G.S.I, also advocated the appointment of a 
“Central Organization, supplemented or not by a Consultative Body of 
experts.” 
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On December 19, 1916, a paper entitled “The Reorganization of Offi¬ 
cial Statistics and a Central Statistical Office” was read before the Royal 
Statistical Society by Geoffrey D r a g e. This paper referred to pre¬ 
vious efforts towards the establishment of a Central Statistical Office 
and concluded that a central direction of official statistics was urgently 
required. 

In June 1919, the Council of the Royal Statistical Society appointed 
a Committee on Official Statistics, who prepared a Petition to His Maj¬ 
esty’s Government representing the urgent need for a reorganization 
of the present system. The Petition referred to previous efforts at re¬ 
form and especially to repeated suggestions which had been made for 
the institution of a Central Statistical Office. The petitioners finally 
submitted that the questions raised were of sufficient importance to 
justify immediate inquiry by a Royal Commission or a Parliamentary 
Committee. The Petition, dated November 1, 1919, was numerously 
signed and duly presented. To consider this Petition a Committee was 
appointed by the Cabinet, who reported on February 8, 1921, that 
in their opinion no case existed for an inquiry, whether by Royal 
Commission or Parliamentary Committee; and they were not in favor 
of the establishment of a Central Statistical Office. They recommended 
however the establishment of a Permanent Consultative Committee 
of Statistical Officers. This recommendation was adopted; and one result 
was the issue of an annual Guide to Official Statistics^ which gave com¬ 
plete references to official publications containing statistics grouped 
under subjects. This proved useful; but little was attempted or accom¬ 
plished in the way of improvement or coordination. 

Sir Henry R e w, in his presidential address “On the Organisation of 
Statistics,” delivered to the Royal Statistical Society on November 16, 
1920, spoke as follows: “A fully equipped Central Statistical Office is 
desirable, competent not only to advise but charged with the respon¬ 
sibility of passing for publication all statistical returns and reports of 
sufficient importance, which are presented to Parliament or published.” 


CttKATION OF THE PRESENT CENTRAL STATISTICAL OFFICE 

So the establishment of a Central Statistical Office seemed to be as 
far off as ever until the conditions created by the second great world war, 
which broke out in 1939, accentuated the urgency of the need for such 
an Office. 

One of the greatest changes which took place during the late war was 
in the collection and use of statistical information to assist in the direc¬ 
tion of economic policy. The technique of using statistics for adminis¬ 
trative control became very highly developed during these years, not 
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only in preparing future programs, but also in using statistics to cteck 
the performance of each major Government program month by month 
or week by week. The statistical departments became concerned with 
providing regularly up-to-date statistical information on which programs 
could be made for a period ahead and by which current programs could 
be kept under review. 

To assist in this work of using statistics intimately in day-to-day Go¬ 
vernment administration and in central control of policy, consequential 
changes were necessary in the organization of the Government statis¬ 
tical service. Central Statistical Organizations were set up in many 
Departments; and further, in order to ensure that the figures collected 
by Government Departments were prepared in a comparable and con¬ 
sistent manner, a Central Statistical Office was established within the 
Offices of the War Cabinet at the beginning of 1941, on the direction of 
the Prime Minister, to maintain day-to-day liaison between the Statis¬ 
tical Divisions of each Department and the Central Executive. The 
responsibility for the collection of basic information still continued to 
rest with the original Departments. Since the War Cabinet had to 
make decisions affecting more than one Department, it was essential that 
the statistics, for example, of imports, production, consumption, and 
stocks, on which these decisions must be based, should be compiled ac¬ 
cording to agreed definitions; and one of the important duties of the new 
Central Statistical Office was to assist in the preparation of statistics on 
the basis of such agreed definitions and in a form consistent with each 
other. 


Functions or the Central Statistical Office 

The functions of the Central Statistical Office include the following: 
(a) as a section of the Cabinet Office it assists the Cabinet Secretariat on 
all questions involving the use of statistics, the preparation of reports 
and the collection of information needed for the Cabinet and its Com¬ 
mittees; (b) it maintains general liaison between the Cabinet Secreta¬ 
riat and the Statistical Divisions of Departments; (c) it acts as a central 
organization for the preparation and circulation of all reports containing 
information obtained from more than one Department, collaborating 
with Departments in the preparation of such reports; and (d) it arranges 
for interdepartmental discussions on ^11 statistical questions. 

To carry out these functions the Central Statistical Office has built 
up an entirely new organization, including an administrative staff which 
has increased from 7 in 1941 to 21 in 1946. The Civil Estimates publi¬ 
shed annually indicate the growth of the Administrative Staff from 1941 
to 1946 as follows: 
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Appointments 

1941 

1942 

1943 

1944 

1945 

1946 

Director 

1 

1 

1 

1 

1 

1 

(Chief Assistants) 




4 

4 


Chief Statisticians 






2 

(Assistants) 

4 

5 

6 

6 

6 


Statisticians 






8 

(Junior Assistants) 

2 

6 

10 

7 

6 


Assistant Statisticians 




$ 


4 

Chief Executive Officer 






1 

Senior Executive Officers 






5 

Total 

7 

12 

17 

18 

17 

21 


Note; Designations in brackets became obsolete in 1946. 


In addition to the Administrative Staff, as noted in the preceding 
table, there is a subordinate clerical staff, which according to a statement 
made in the House of Commons by the Chancellor of the Exchequer on 
November 13, 1945, amounted to 32 persons. 

The duties of each Administrative Officer include (a) the maintenance 
of day-to-day liaison with the Statistical Divisions of Government De¬ 
partments; (b) keeping himself informed of all problems of policy within 
his field of study as well of changing methods of compilation of the sta¬ 
tistics with which he is concerned. 

The majority of the reports and statistics prepared by the Central 
Statistical Office are of a confidential nature and are circulated to Cabinet 
meetings and Government Departments only; but the following publica¬ 
tions have been issued by the Office: “White Papers” on War Finance 
and Estimates of the National Income and Expenditure for each of the 
years 1941 to 1946, and Statistics Relating to the War Effort of the United 
Kingdom in 1944. 

From the public point of view, one of the most important of the issues 
of the Central Statistical Office is the Monthly Digest of Statistics, which 
was begun in January 1946. This is a large quarto of nearly 100 pages, 
published at the price of 2s. 6d. In the Introductory Notes to the first 
issue, it is stated that the Digest has been prepared by the Central Sta¬ 
tistical Office in collaboration with the Statistics Divisions of Govern¬ 
ment Departments, and that the Departments and organizations res¬ 
ponsible for providing each series of statistics are stated under each table. 
The aim is to publish in summary form statistics which show the chang¬ 
ing pattern of the economic activity of the country. All the statistics 
are therefore presented in the form of time series. Figures are given, 
BO far as possible, for each of the calendar years 1935 to 1944 and monthly 
since the beginning of 1944. It is stated also that the scope of the Digest 
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will be revised from time to time to include new statistical information 
as it becomes available. Many of the series appearing in the Digest are 
given in greater detail in other official publications, as, for instance, the 
Board of Trade Journal, the Ministry of Labor Gazette and the Trade Ac- 
counts. 

The Digest contains upwards of 100 Tables, comprising the following 
subjects; Population; Employment; Fuel and Power; Raw Materials; 
Manufactured Goods; Building; Agriculture and Food; External Trade; 
Merchant Shipping; Inland Transport; Finance and Wages and Prices. 
Most of the figures in the tables are expressed in thousands. 

In January 1946, the Central Statistical Office issued as a supplement 
to the first issue of the Monthly Digest a sixpenny octavo pamphlet of 32 
pages entitled “Definitions of Items and Units in the Monthly Digest of 
Statistics.*’ This is essential even for preliminary understanding of 
the Tables. 


Lines of Fcttube Development 

In a paper “On the Future of Statistics,” read before the Royal 
Statistical Society on April 21, 1942, Mr. M. G. K e n d a 11, discussing 
the possibility of a State Statistical Office, wrote as follows; “There is 
now in existence an offshoot of the Cabinet Secretariat, known officially, 
I think, as the Central Statistical Office. Like many other English ins¬ 
titutions it was an improvisation; like many other English institutions 
it may outlast the creations of the most solicitous bureaucratic tecto¬ 
nics.” He suggested that the Royal Statistical Society should debate 
the question very seriously and make some recommendation to the Go¬ 
vernment. 

In 1943 the Council of the Royal Statistical Society issued a “Memo¬ 
randum on Official Statistics,” which covered a wide field. They stated 
that in their view the formation of a Central Statistical Office was a 
development of great significance, and the principle of providing a co. 
ordinating body of this kind was one which they cordially welcomed. 
They set out in detail the principles that should in their view be observed 
in reorganizing the Office after the war; and the following are those of 
their recommendations which have special reference to a Central Sta¬ 
tistical Office; 

(1) Every major Department should have a statistical branch under the direc. 
tion of an administrative officer; and minor Departments should either have 
a smaller unit or work under the guidance of the statistical branch in a major 
Department or of the Central Statistical Office. 

(2) Firm coordination of the statistical work of different Departments is neces¬ 
sary. This may best be effected by a Central Statistical Office acting with 
\ a small Committee selected from among the heads of statistical branche 
\ in the major Departments. 
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(3) The Committee should be small» should dll its own vacancies, should be em¬ 
powered to initiate subjects for discussion, and to issue reports on statistical 
matters not falling within the province of any one Department. Its deci¬ 
sions should be binding on Departments, subject, on major matters, to 
Cabinet authority. 

(4) The Central Statistical Office should be relieved of routine analysis and ad¬ 
ministration, should, inter alia, undertake research work, should act general¬ 
ly as a coordinating body, should compile statistical information required 
for the Cabinet and its Committees on subjects where the interests of more 
than one Department are concerned and should secure prompt and full publi¬ 
cation of Government statistics. 

In May 1944, that is before the end of the war against Germany and 
Japan, the Minister of Reconstruction presented to Parliament an impor¬ 
tant “White Paper” (Cmd. 6527) on Employment Policy. This envi¬ 
sages a considerable development of statistical activity dependent upon 
effective cooperation between the Government and industrial represen¬ 
tatives. It is stated that “the Government appeal with confidence to 
industry to join with them in a task which is essentially cooperative; 
for only industry can provide the statistical information required, and 
only a central authority can clarify and analyze information drawn from 
the country as a whole.” The Report states that the following are the 
principal classes of statistics (in addition to those available before the 
war) which must be obtained for the efficient operation of an employ¬ 
ment policy: 

(a) Statistics of employment and unemployment, including quarterly or monthly 
statements of present and prospective employment in the main industries 
and areas in the country, based on returns from employers. 

(b) Regular information relating to savings, projected capital oxpeiuiiture 
by public authorities, and, as far as possible, by private industry. 

(e) An Annual Census of Production showing the structure of the main groups 
of industries in the preceding year, including, inter alia, details of the quan¬ 
tity and value of output, stocks, and work in progress. 

(d) Monthly figures of production, consumption, and stocks and, if possible, 
figures of orders on hand, based on sample returns obtained periodically 
throughout the year from large firms, trade associations, and public insti¬ 
tutions. 

(e) Annual and quarterly estimates of foreign capital movements and balance 
of foreign payments. 

It is thus evident that there will be abundant scope in future for the 
activities of the Central Statistical Office, if it may be assumed that the 
“Central Authority” above mentioned should be the Central Statistical 
Office already in existence. 

A Statistics of Trade Bill, promoted by the Board of Trade, was read 
a second time in the House of Commons on January 21,1947, and received 
the Royal assent on July 31, 1947. It provides for the collection of 
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statistical information from industrial undertakings, for an Annual 
Census of Production from 1948 and for a Census of Distribution and 
other Services in any calendar year as may be prescribed by Order of 
the Board of Trade. The Central Statistical Office is not - mentioned 
specifically in the Act; but doubtless the Office will take due cognizance 
of the result obtained under the powers it confers. 

A paper on “Statistics in Peace and War” was read before the Man¬ 
chester Statistical Society on June 14, 1944, by Mr. H. Campion, 
who has been Director of the Central Statistical Office since May 1941. 
In this paper, Mr. Campion reviewed the statistics up to the outbreak 
of the late war; described the development of statistics since the out¬ 
break of the war, and referred to statistics after the war. Respecting 
the recommendations of the Royal Statistical Society given above, he 
writes: 

“These proposals are still under consideration by the Government, but 
already the Chancellor of the Exchequer has stated in the House of Commons 
that some form of statistical organization will be kept in existence. Further, 
in the White Paper on Employment Policy, the Govermment announces 
its intention to establish a central staff to measure and analyze economic 
trends to help in the direction of a full employment policy. It now seems 
clear that the Government intend to take a load in developing statistical 
work after the war and that the statistical service of the Government will 
be considerably strengthened.” 

# 

The Economist of September 5, 1944, had an article on the Coordina¬ 
tion of Statistics, from which the following is an extract: 

‘‘The machinery of coordination is also already in being ombryonioally. In 
1941 the Central Statistical Office was formed to reduce the mass of depart¬ 
mental data to terms that could be of service to the War Cabinet.... There 
must be a real coordination; and it is a well-tested principle that coordination 
works most smoothly and most efficiently if those whose work is to be coordi¬ 
nated are brought together to do the coordinating. Efficient coordination 
could most easily be achieved by continuous cooperation between the Central 
Statistical Office and a Committee chosen from the heads of the departmental 
statistical branches.” 

Reference has already been made to the various annual Statistical 
Abstracts of the Board of Trade and to their suspension during war; 
but it has been recently announced that the Statistical Abstract for the 
United Kirt^dom is now to be resumed, and is to be published in 1947, 
for the first time, by the Central Statistical Office instead of by the 
Board of Trade. The one last issued gave for the fifteen years, 1924 to 
1938, the statistics available over a wide field including: climate; popu¬ 
lation; social, civil and industrial conditions; defense; finance; agricul¬ 
ture; fisheries; mining; metals; transportation; shipping; trade and com¬ 
merce, etc. 



EBNBST H. GODFEBY 


479 


Conclusion 

The fact that a Central Statistical Office, so long advocated, is now in 
existence appears to open up important possiblities of future develop¬ 
ment . From what has already been stated, it is clear that there is abun¬ 
dant scope for the future activities of the existing Central Statistical 
Office, which the Government has apparently decided definitely to 
maintain. In conclusion I would submit that one direction which its 
activities might well take is the publication of a Statistical Year Booh, 
as indeed was suggested by Geoffrey Drage in his paper of December 
19, 1916, already mentioned. Such a publication should have adequate 
explanatory letterpress of tables over a series of years to illustrate pro¬ 
gress in all departments of the public life. Special articles descriptive 
of the British systems of central and local Government, education, 
National Health Service, etc., would be of value. U^ful publications 
of this kind have long been issued by the Dominions, notably by the 
Bureau of Statistics of the Dominion of Canada and by the Census and 
Statistics Office of the Commonwealth of Australia. 


Resume 

L’auteur donne d’abord un aper 9 u des efforts faits, pendant de nom- 
breuses annees, par les statisticiens britanniques en vue de Tameliora- 
tion des statistiques officielles par la creation d’un Office Central de 
Statistique. 

Sous rinfluence des besoins urgents causes par les circonstances de 
guerre un tel office a ete cree en 1941. 

L’auteur fait un expose de la composition et du fonctionnement de 
rOffice Central et donne des details sur ses publications. II trace, dans 
ses grandes lignes, un plan de developpemcnt futur. 


Discussion 

Mr. Leak remarked that Mr. G o d f r e y’s paper should be regarded 
as essentially a historical document. Mr. Idenburg commented 
on the significance of the British experience in developing centralization 
and coordination of statistical work. 



UNE FAMILLE DES CLASSES MOYENNES D'UNE 
GUERRE MONDIALE A L’AUTRE, 1914 1947 


par Ugo Giusti 
(Italie) 

Dans nos recherches sur les conditions des difF6rentes classes sociales 
on a bien difficileraent Toccasion de disposer d’une histoire complete et 
sincere d’une famille des classes cultivees, pendant une p6riode assez 
longue. C’est que les hommes ouvrent plus facilement en prose et en 
vers, aux regards du monde, les endroits les plus caches de leur coeur 
et les passions qui les agitent, que les chifFres les plus innocents de 
leur budget domestique. 

D’ailleurs, si des documents de ce genre sont toujours une source pr6- 
cieuse d’information pour T^conomiste et le sociologue, le statisticien, 
au contraire, ne peut en profiter que s’il connait parfaitement les change- 
ments de tout ordre survenus dans la famille dont il a les donn6es. 

J’ai done profite bien volontiers de la confiance d’un de mes amis qui 
avait eu la patience de suivre reguli^rement et avec la plus grande pre¬ 
cision, pendant plus de trente ans, sa comptabilite familiere, pour en 
tirer un tableau ou sc reflfetent les grands evenements qui ont change 
deux fois de suite d’une fa 9 on radicale les conditions economiques d'une 
grande partie de la population italienne. 

De cette etude monographique encore inedite je ne prendrai ici que 
quelques details des plus significatifs dans Tespoir qu’ils soient suffisants 
pour donner une idee de ce qu'est devenue k Fheure actuelle, dans mon 
pays, une partie importante des classes moyennes. 

(a) Pendant la premiere guerre mondiale 

La famille qui, de 1914 k 1921, residait k Florence, se composait de 
cinq membres: le p^re de famille, un fonctionnaire administratif de ^1 
ans, un garden de 14 et trois femmes respectivement de 74, 46, et 18 ans. 
Son budget se pr^sentait au commencement et k la fin de la guerre de la 
mani^re suivante: 

Revenu des Annees 


1914 

1918 

Traitement 

Lires 

6,000 

Traitement 

Lires 

6,000 

Int4r^ts 


3,000 

Indemnity de vie chere 
Int^rets 


1,100 

1,600 




Activity personnelle de la mSre 




de famille 


1,600 


Lirea 

8,000 

1 

Lires 

10,100 
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C^est seulement k la moiti6 de f6vrier 1918 qu’on a pu b6n6ficier d’une 
indemnity de vie ch^re de 18% «ur le traitement tandis que le chiffre- 
indice du coClt de la vie (100 la fin de decembre 1913) etait dej^t mont4 
a 108 en decembre 1914, k 138, 150, et 224 respectivement k la meme 
date de 1915, 1916, et 1917 pour continuer sa course jusqu'4 501 en 1921, 
terme extreme, pour ce moment, de sa montee. Pendant ces annees, 
la famille a du liquider une partie de ses epargnes et la m^re a donne des 
le 9 ons. Mais ni ces nouvelles ressourCes, ni les reductions radicales des 
d6penses que nous verrons bientot, n’ont suffi a maintenir Tequilibre du 
budget: 


19U 

1918 

Revonus 

Li res 8,000 

Revenue 

Lires 10,100 

Depenses 

6,492 

Depenses 

10,697 

Solde actif (H-) 




ou passif ( —) 

Lires 1,508 


— Lires 497 


La distribution des dispenses dans les deux ann6es etait assez diff6- 
rente: 


. .■■ - ■ 

■ 1914% 

1918 % 

Alimentation 

40 *0 

66 -0 

Eclairage et chauffage 

2-8 

6*2 

Logement (loyer) 

11 -6 

7 *1 

Produits hygi^niques et blanchissage 

1 *8 

2*6 

V5tement et amoublement 

6 1 

7*5 

M6decin et medicaments 

1 -4 

1 *9 

Service dornestique 

4*6 

4-5 

Vill6giature, voyages, etc, 

9 *3 


Diverses 

5 *9 

2 *3 

Impdts et taxes 

16*5 

12-9 


100 *0 

100 *0 


Les depenses de villegiature, de voyages, etc., ont disparu en 1918; le 
cofit du loyer, maintenu par le moratorium bloque pendant la guerre, 
a perdu dans le pourcentage plus de quatre points; 1 alimentation, au 
eontraire, en a gagn6 seize inalgr6 la grande diminution en poids et en 
quality des produits consommes: 
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Consommation quotidienne par unit^"* 





1914 


1918 

Pain et plltes alimentaires 


Kg 

0,660 

Kg 

0,381 

umes (verts et secs) et fruits 

* 


0,394 


0,490 

Viande de toute espbee 



0,148 


0,077 

Lait, beurre, fromage, oeufs 



0,676 


0,676 

Sucre 



0,066 


0,023 

Huile d’olive 



0,030 


0,016 

Vin 



0,166 


0,093 



Kg 

2,040 

Kg 

1,664 


* Le coefficient pour riiomme adulte 6tant fix6 ^ 1, on a appliqu6 celui dc 0.75 pour les femmes et 
le garcon. II faut pourtant observer que si, non sans quelques reserves, on peut accepter des 6chc]les 
de ce genre quand il s'agit de comparer de grandes masses de consommateurs, elles ne sont pas appli- 
cables & des groupcs d’individus plus limit6s et bien connus dans leurs habitudes et dans les caract6ris- 
tiques de leurs consommations, et, moins encore dans la monographic d’une famille, sans tenir compte 
des conditions r^elles physiques et sanitaires des membres do la famille 6tudi6e. 


Traduite en valeurs nutritives et calorifiques, cette consommation 
donnait les resultats suivants: 


1914 1918 


Proteines 


gr 

do 

gr 

75 

Corps gras 



165 

76 

Carbohydrates 
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336 

Calories (vin exclus) 



3,761 


2,391 


(B) Entre les deux guebres 

Aprfes les difficult^s du passage de la guerre k la paix,- Tannee agricole 
de 1923 exceptionnellement favorable permettait k Tltalie de reprendre 
haleine et de maintenir les progr^s deja acquis, contrairement k ce qui 
arriva aprfes la fin de la guerre recente et Tannee agricole de 1945 excep¬ 
tionnellement mauvaise. 

Les effets de la deflation monetaire, de la crise mondiale et, k Tappro- 
che de la seconde guerre, ceux de Fautarchie poursuivie par le gouverne- 
ment fasciste, se r6fl^tent dans le mouvement des nombres-indices 
des prix de gros et, moins vivement, dans celui du cofit de la vie: 


Nombres-indices (1922 = 100) 


Ann6e 

Prix de gros 

Cout de la 
vie 

Ann6e 

Prix de 
gros 

Cout de la 
vie 

1923 

100.9 

99.4 

1932 

64.9 

89.4 

1924 

100.4 

102.9 

1933 

69.1 

86.6 

1925 

112.6 

116.6 

1934 

67.8 

81.2 

1926 

114.8 

124.7 

1936 

63.6 

82.4 

1927 

96.5 

114,0 1 

1 1936 

71.2 

88.8 

1928 

93.2 

106.7 

! 1937 

83.0 

97.6 

1929 

88.9 

107.6 

I 1938 

88.8 

105.4 

1930 

79.6 

103.9 

1 1939 

92.6 

110.1 
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Les depenses alimentaires de la famille suivent de pr^s les nombres- 
indices nationaux; si les d6penses de 1928 sent faites egales k 100, on a 
pour les ann6es de 1932 k 1937: 

1932 — 81.7 1934 — 74.6 1936 — 83.4 

1933 — 77.3 1935 — 76.2 1937 —90.5 

Les economies familiales qui ne produisent pas des biens economiques, 
ont ressenti, en sens inverse des economies de production, la crise des 
prix dans les marches internationaux; noire famille s’est trouvee soula- 
g6e, pendant ces annees de bas prix, des pertes subies pendant la guerre 
et Tapr^s-guerre immediate, mais ce soulagement a ete bien peu de chose 
en comparaison aux d^sastres que devaient apporter la nouvelle guerre 
et sea effets directs et indirects. 

A titre d’exemple, nous donnons le budget de 1934. La famille, qui, 
d^s 1922, r6sidait ^ Rome, etait restee composec de quatre membres: 
deux hommes (de 61 et de 33 ans en 1934) et de deux femmes (de 69 et de 
24 ans). Ses revenus se composaient k cette date d’une pension de 
retraite de 12,000 lire?, d’un traitement de 24,000, d'un loyer figuratif de 
10,000 lires pour un appartement de propri6te; au total, 46,000 lire. Le 
total des depenses etant de 42,986 lires, il y avait un excedent actif de 
3,014 lire?. 


La classification des depenses etait la suivante: 


Alimentation 

% 

20.6 

Medocin et m6dicamenta 

% 

3.4 

Eclairage et chauffage 

3.8 

Service domestique 

4.8 

Logoment (loyer figuratif) 

26,3 

Villdgiature voyages, etc. 

16.4 

Veti'ment et ameublement 

9.5 

Diversos 

6.9 

Produits hygieniques et 
blanch issage 

l.l 

Impots et taxes 

9.8 


La consommation quotidienne par unite est indiquee ci dessous en 
poids de produits consommes, en valours nutritives, et en nombre de 
calories: 


Pain et p4tos alimentaires 

Kg 

0.330 

Proteines 

gr 

107.2 

L6gumes verts et secs, fruits 


0.672 

Corps gras 

gr 

123.6 

Viandes do toute espece 


0.107 

Carbohydrates 

gr 

326.8 

Lait, beurre, fromage oeufs 


0.470 




Sucre 


0.019 




Caf6 


0.010 

Calories 


2,921 

Huile d’olevi 


0.029 




Vin 


0.267 





Kg 

1.804 
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En comparaison avec rann^e 1914, on pout remarquer en 1934 une 
diminution trfes forte dans le pourcentage des depenses pour Talimenta- 
tion (20.6 au lieu de 40) due enpartieau changement r6el dans la quantite 
et dans la qualite des produits*consommes (236 gr. de moins par jour; 
16gumes au lieu de laitages, de sucre, etc.) et, indirectement, au plus 
haut prix des loyers, maintenus par le moratorium k Florence en 1918 
et libres k Rome en 1934, et aux plus fortes depenses pour villegiatiire, 
voyages, etc. 


(c) Pendant la seconds guerre mondiale 

Si des decrets du gouvernement ou, en g6n6ral, des rfeglements gouver- 
nementaux pouvaient regler la vie des societ6s humaines, nous pourrions 
dire que le gouvernement italien avait bien protege ses administres des 
le commencement de la guerre, des dangers du rencherissement du coOt 
de la vie. “Aucune augmentation,*’ disait un decret de juin 1940, 
“ne sera consentie sur les prix en vigueur pour les marchandises de touto 
espfece, les services, etc,”; quelques centaines de decrets qui ont suivi 
admettaient tout au plus des exceptions et garantissaient pour le reste. 

On est tent6 de rechercher ce que nous indique k cet 6gard le chiffre- 
indice officiel du cofit de la vie a Rome (1928 = 100): 

1939 — 107-28 1941 — 144-14 

1940 — 125-37 1942 — 169-82 

Aprfes 1942 la voix officielle a garde le silence; c’etait le mieux qu’elle 
pouvait faire malgre la precision jusqu’aux centimes dont elle faisait 
parade; la comptabilit^ de notre ami nous dit en effet qu’en juin 
1942 il a d^pensellOl lires pour 75 kilos de produits alimentaires au lieu 
de 448.90 pour 97 kilos au meme mois de 1939; tout simplement parce 
qu’un kilo de viande de boeuf, indique sur la mercuriale officielle L. 
18.78, lui a co6t3 81.25; un kilo de beurre 100 lire au lieu de 27 et ainsi 
de suite pour les autres produits. 

Nous n’avons pas le temps de faire des commentaires sur Taction des 
pouvoirs publics dans cette mati^re, mais nous en verrons les effets ne- 
gatifs ^ travers les chiffres du budget dont nous disposons. 

Ce sont d’abord les revenus qui t&chent en vain de tenir tete aux 
depenses; au lieu du traitement de 24,000 lires, on voit en 1940 une con¬ 
tribution de 15,000 du fils de famille, 10,000 lires d’int^rets, et 5,000, 
produit de Tactivite du chef de famille; tout 9 a ensemble fait 52,000 
lires. 

Mais les prix, malgr6 gouvernemental clt4 plus haut, montaient 
d6j^ sensiblement et les depenses pour Talimentation passaient de 9,862 
eu 1934 & 12,228 lires en 1940; des Economies sur les depenses pourle. 
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vill6giature et sur quelques autres chapitres ont permis de retablir I'equi- 
libre en r^duisant le total des d^penses k 45,545 lires, etlaissant un 
sold3 actif de 6,455 lireB. 

Apr^s quatre ans, nous trouvons une situation bien dififerente; les reve- 
nus ont monte de 52,000 4 89,000 k la suite d’une allocation de vie chere 
et d’un redoublement d’activite personnelle, mais les depenses ont monte 
plus vite de 45,565 a 193,931 lires, en laissantun deficit de 104,931 lires. 

Le simple pourcentage des difFerents chapitres des depenses dans les 
deux annees nous dira eloquemment ce qui s’est passe dans I’intervalle: 



1940 

1944-46 

Alimentation 

26.9% • 

71.2% 

Eclairage et chauffage 

5.2 

6.5 

Logement (loyor figuratif) 

24.7 

6.4 

Vetements ot ameublement 

11.2 

2.0 

Produits hygi^niques et blanchissage 

1.9 

3.0 

M^decin et m6dicaments 

2.1 

1.7 

Service domestiques 

5.3 

3.6 

Villegiature, voyages, etc. 

10.4 

— 

Diverses 

7.3 

3.4 

Impots et taxes 

5.0 

2.2 


Les depenses alimentaires qui correspondaient en 1940 a un quart 
environ de la depensc totale (pourcentage qu’on pent considerer normal 
pour une famille des classes moyennes dans des circonstances egalement 
norm ales), comprenait en 1944-45 presque les trois—quarts du budget 
passif malgre la.forte augmentation absoluc dans les autres chapitres, 
exception faite pour les depenses de villegiature et des voyages qui ont 
ete supprimees. C’est le pourcentage qui caracti'rise ordinairement les 
budgets des families les plus raiserables. 

L’annexe nous presente I’histoire alimentaire de la famille dans les 
annees de la guerre rece ite et lointaine; les 2,912 calories quotidiennes 
par unite consommatrice au mois de mars 1939 descendent k 1,633 en 
avril 1944 (actions de guerre pr4s de Rome) pour remouter 4 presque 
3,000 en decembre de la meme annee, et, apres une nouvelle baisse, 
4 la meme quantite au commencement de 1947; mais c’est Torigine de 
ces calories aux differentes epoques qui est bien differente: equilibre de 
principes nutritifs en 1939; manque presque absolu de produits alimen¬ 
taires en avril 1944; forte consommation de cereales accompagnee par 
une absence presque totale de viande et de corps gras 4 la fin de la meme 
ann6e. La situation a fort peu change 4 cet ^gard dans les premiers 
mois de 1947; la carte de rationnement n’y a jou6 qu’un bien faible role; 
si, en 1942, elle pouvait fournir 40% en poids de la consommation et 13% 
de la d^pense relative, elle n’a doime depuis 1944, tout en comprenant 
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un supplement d*infirmit6, que de 13 k 20% en poids et de 2 4% des 

d^penses. 

Malgre les reductions remarquables, surtout en quality, des produits 
consommes et les preoccupations d’ordre economique qui les ont accom- 
pagnees, il est interessant de constater que la sante de la famille et meme 
celle de la vieille dame infirme, n’en ont pas souifert. Tous ont plus ou 
moins diminue de poids mais seulement le pfere de famille d’une manifere 
evidente (21 kilos sur 80) avec quelques manifestations do faiblesse dans 
les derniers temps; la forte consommation de pain et de p&tes alimen- 
taires achetes au marche libre lui ont fait assez rapidement reprendre 
son ancien poids. 

Toutes ces reductions n’ont pourtant pas empeche, comme nous avons 
vu, renorme deficit de 100,000 lires qu’on a comble en ali 'nant des epar- 
gnes es une quantite d’objets personnels et de meubles. 

L’annee 1946 qui aurait dfi apporter, avec la paix, un peu plus de 
tranquillite et de soulagement, nous a donne une cruelle deception; les 
prix des denrees ont monte presque sans interruption; le budget 
mensuel de depenses qui etait de 16,161 lire pour quatre personnes en 
1944-45 monta k 30,000 pour trois au commencement de 1947. Malgre 
Taugmentation en valours absolues de toutes les depenses, I’alimentation 
absorbe toujours les trois-quarts du budget passif et exige au mois de 
mars 1947 plus de 300 Urea quotidiennes par unit? consommatrice. 

La reconquete de mille calories entre 1944 et 1947 n'a pas fait oublier 
a difference radicale entre les repas d’aujourd’hui et ceux d'il y a quatre 
ou cinq annees seulement; plus de beurre, de vin, de caf?; presque plus 
de viande; une cuisine egale, monotone, comme celle d’un etablissement 
d’assistance publique a remplace les jouissances, pourtant inodestes, 
de la bonne ch^re familiale de jadis. 

D’ailleurs le budget, qui n’est qu’un compte de caisse, ne nous dit 
rien du riche patrimoine de la famille qui va disparaitre; ce sont dei 
meubles qu’on ne peut plus entretenir, des vetements, du linge, des Sou¬ 
liers qu’on ne peut plus renouveler; la maison meme ou la famille habite 
lui est devenue un poids trop lourd pour sa condition actuelle et peut- 
etre devra-t-elle I’abandonner; on tremble k la pens?e d’une maladie; 
I’avenir se pr6sente bien noir. 

II n’est ni difficile ni arbitraire do remonter de ce fait personnel (surtout 
si on peut s’en rendre compte, non dans ces notes rapides, mais dans la 
riche documentation de la monogrs^phie) au fait collectif qui se mani- 
feste sous nos yeux. C’est la d^cheance economique, et partant sociale, 
des classes moyennes, de toute une classe qui voit le travail d’une vie 
eiitifere an^anti, qui, sans force de lutter centre les adversit^s, tembe 
■jour par Jour^dans une mis^re d’autant plus douloureuse, caoh6e comme 
elle Test par: les restes d’un bien-etre recent, par les habitudes d’uiSe 
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soci6t6 cultiv6e, par la repugnance de ces nouveaux pauvres aux protes 
tations bruyantes. 


Annex 


Consommation quotidienne, calories, depenses par unite consomma- 


trice, cout de 1000 

Date 

calories 

Consom¬ 

mation 

(grammes) 

Calories 

Dtpense 
(Li res) 

Cout de 1000 
calories (Lires). 

Juillet 

1914 

2,040 

3,876 

1.68 

0.43 

Aout 

1918 

1,654 

2,456 

3.51 

1.43 

Juillet 

1928 

1,698 

2,911 

9.26 

3.18 

Sept. 

1932 

1,781 

2,966 

7.63 

2.59 

Sept. 

1935 

1,804 

2,921 

7.10 

2.43 

Sept. 

1937 

1,774 

2,949 

8.83 

3.00 

Mars 

1939 

1,835 

2,912 

8.57 

2.95 

Juin 

1942* 

1,407 

2,121 

21.20 

10.00 

Juin 

1943 

1,597 

2,443 

18.80 

7.71 

Octobre 

1943 

1,327 

2,611 

31.20 

12.00 

Novembre 

1943 

1,388 

2,344 

44.00 

18.80 

Janvier 

1944 

1,125 

2,304 

44.30 

19.30 

Avril 

1944 

956 

1;633 

108.00 

66.30 

Mai 

1944 

1,014 

1,827 

158.30 

86.50 

Juillet 

1944 

1,700 

2,366 

96.50 

40.70 

Dccembre 

1944 

1,449 

2,993 

104.00 

34.60 

Mars 

1945 

1,339 

2,624 

103.00 

39.30 

J anvier 

1947 

1,800 

3,005 

244.00 

81.30 

»N'A partir do 1942 et pendant dos moia. 

certains produits alimentaires manquaient 


totalemont sur le march6; ces changements d‘aUmen.tation apportaiont de fortes 
differences dans le rendement en calories. Voir, par exomple, Teffet de la forte 


consommation do legumes et do fruits secs en d^cembre 1944. . 


R^6um4 

We seldom have available the economic histoi'y of a family for a period 
of thirty years—that is through the two world wars—as is the case for 
the Italian family of the middle classes of which this paper gives a brief 
account. Particularly interesting with regard ‘to this subject is, for 
instance, a comparison between the family budget of 1940, at the be¬ 
ginning of the war when it was still possible to save 10% of income, and 
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the budget of 1944-45 when the family was obliged to sell 100,000 lires 
of funds and commodities to meet expenditures. The distribution of 
funds was of course completely different at those two dates; only 26.9% 
for food in 1940 (a normally characteristic percentage for the middle- 
class standard of living) and almost three-quarters of the whole expen¬ 
diture (71.2%) four years later, that is, the usual percentage for families, 
in the most wretched economic condition. The expenditures for travel 
theater, etc., had disappeared from the budget in the meantime. The 
great want of food products in the midst of the war (for Rome, April 
1944) caused a reduction of the normal number of calories (from 2900 
to 1633 per person per day); already in December 1944 the former number 
was recovered but now it corresponded to a wholly different sort of 
diet: no more butter, wine, coffee, seldom any meat; a tedious diet 
based on bread, maccaroni, eggs,, and vegetables had taken the 
place of the pleasant variety of meals available formerly. Pleasure was 
greatly reduced but the health of the family did not suffer exce-sively 
from this change. It is easy to pass in the consideration of these facts 
from an individual to a collective conclusion: a large part of our middle 
classes looks, without possibility of defense, at the ruin of all the results 
of its life work and suffers particularly under its misfortune just because 
that misery is often concealed under the remainder of recent prosperity. 



bSSERVAZIONI SUL METODO DI RILEVAZIONE 
SUL VOLUME DELLA CIRCOLAZIONE SOCIALE 

per Livio Livi 

UniversiUi. di Firenze {Italia) 

Si parla molto dei problemi relativi alia circolazione sociale, inten- 
dendo con questo termine quella parte del flusso di rinniiovo del ceto 
pi{i elevato della societal costituito da persona provenienti dal ceto dei 
lavoratori manuali; ma in reaM ben poco si coriosce del volume di questo 
movimento e delle vie che esso segue. Parzialissime e scarse sono an- 
che le ricerche sul grado di selezione cui sono soggette le persone che pro- 
vengono ai posti pih elevati dagli strati pin bassi, rispetto a quelle che 
hanno origine da famiglie gia stabilizzate ncl ceto medio o alto.^ 

Eppuro, dopo i primi ben noti studi del F a h 1 b e c k,2 I’argomento 
e stato ripreso piu volte ma sempre in modo parziale e con riferimento 
a quella parte della circolazione che si sviluppa per il tramite della scuola 
superiore.^ 

> Abbiamo solo conoscenza dei seguenti seritti; T. M. Livesay, “The Relation of 
Test Intelligence of High School Seniors in Hawaii to tho 0(‘cupation of Their 
Fathers,” Journal of Applied Psychology, 25, 1941. h\ Zeiithan, ‘Professione o 
posizione sociale sono ereditarie?” Sociaiisten, 1033. 

* P. Fahlbeck, “Les clas.ses sociales,” Bull, de VInM. ltd. dp Stat., XIX, 3me 
livr. 

* Tra i pi(i recenti citiamo: H. B. Goetsch, Parental Income and College Oppor- 

New York, 1940, Olot, “Conditions dconomiques des etudinnts,” Helsinki, 
Bureau Centr. de Stat., 1939, edizione bilingue finnico e svcdose con ria.ssiinfo 
francese. Vincenzo Cast^illi, “Origine sociale des etudiont«5,” Bull, de VJnst. ltd. de 
Stat., 1940. Academie de Paris, Enquetes aur le Baccalauriat , Pari.'\ 1936. 
G. Deyerler, “Soziale Schichtung und schulische Leistung der volksscbulpflictigen 
Yugend Miinchens,” “Bayer. Stat. Lande.3amte, 1936. G. Just, “Schulau.sloso und 
Lebensleistung” Arch. f. Bevolkerungwissenschaft, XIT, 1935. OHico de Statistique 
de la Rep. Tshecoslov., Conditions .sociales des itudiants des 6coles sup6rieures 
de Brno, 1935. R. Lotzc, Unter.mchungen uber die Bezichungen zvdsohen Schulleh- 
tungen, sozialer Schichtung und Fatniliegrosse,"* Stuttgart, 1934. A. O. Molnar, 
Le condizioni sociali ed econotniche degli studenti di scuole superior' a Budapest, Bureau 
de Stat. de la Ville de Budapest, 1934 (in iinghcrese). J. Wisniewski e E.Violrose, 
Riaultati del Vinchiesta sulla situazione economica degli studenti delle scuole centrali 
di Cammercio di Varsavia," Varsavia, 1938 (in polacco). M. Miller, The Generations, 
A Study of the Cycle of Parents and Children, London, 1938. P. Fortiuiati, “H 
ricambio sociale secondo le indagini sulla struttura deniografica della studcntesca 
universitaria di Padova,” Annali delVUniversita d^ Ferrara, 1937. S. P. Ratz 
Kotsicas, “L’orientation professionelle des ^tndiants en Grece, par rapport 4 la 
profession du pore,” Bull: de VInst. Int. de Slat., 29, 1937. D. Krejci, “Experiences 
faites en Tch^coslovaquie au cours des relev6s statistiques ccncemant la condition 
sociale des 6tudiants,” Bull, de VInst. Ini. de Stat. XXIX, 1937. 
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Quegli studi poi ohe non si pongono questo confine si sono dovuti 
restringere per la mancanza delle fonti statistiohe alio spoglio di nomi 
registrati in dizionari biografici o di persone ospitate in istituti speciali,^ 
oppure si sono basate sopra elementi indiretti tratti dai censimenti domo- 
grafici.® 

Noi stessi, come vedremo, per avere una idea della importanza quanti- 
tativa della circolazione sociale nella categoria degli imprenditori indus¬ 
trial! e commerciali, abbiamo dovuto far ricorso ad un annuario della 
society per azioni. 

E’ doloroso per gli statistic! essere costretti a coltivare un campo 
cosi vasto e fertile con attrezzi cosi meschini. 

Si aggiunge poi Tinconveniente che le cifre cosi raccolte si riferiscono 
per solito a concetti molto confusi, e sono percio mal comparabili. Si 
parla di ceto alto o direttivo, e di ceto dei lavoratori manual!, ma 6 ovvio 
che a quest! concetti possono darsi definizioni diverse e tutte molto 
imprecise per la stessa complessita dell’oggetto. Esporremo nel para- 
grafo successive un metodo che non renderebbe necessarie queste equi- 
voche definizioni, ma per ora non siamo potuti andare al di l^t di una 
sempliceproposta. 

Inoltre il volume di questa circolazione, anzich6 sui fenomeni di fiusso, 
puo essere studiato, come per 16 pih avviene, sui fenomeni di stato, cio6 
in base alle frequenze cosi come appaiono in un dato istante nella col- 
lettivit4 considerata. Ma i risultati sono diversi secondochfe, della 
circolazione socilae si considera Taspetto dinamico e Taspetto statico, 

Vi fe^poi da precisare il termine *‘a quo” del passaggio. Si puo passare 
dal basso ceto ai posti direttivi nel corso stesso della vita. Potremo 
chiamare quest! passaggi di 1° grade. Il Prof. L u z z a 11 o-P e g i z, 
pur non potendone dare una misura, ha dimostrato che questa circo¬ 
lazione fe notevole.® 

Seguendo la linea maschile vi sarebbero poi passaggi di 2° grade da 
padre a figlio; di 3° grade da nonno a nipote, e cosi via; ma non conver- 
rebbe certo andare pih oltre. 

Dovrebbesi anche stabilire se e come tener conto della discendenza 
femminile; sarebbe anzi interessantissimo comparare la circolazione 
sociale maschile, cio6 calcolata per i maschi seguendo la linea paterna, 
e quella femminile, cio6 calcolata per le donne seguendo la linea materna. 
Le dififerenze potrebbero essere notevoli. 

* “Sozialer Auf—und Abstieg im duetsohen Volke/* Bayer. StaL Landesamt, 1930. 
A. Odin, “Genese des grands hommes,” Paris. 

» Taussing e Joslyn, Americar^ Business Leaders^ New ‘York, 1932. Pierpaolo 
Luzzatto-Fegiz, “The Occupational Evolution of a Generation,** Population, 
Vol. IT, 1935. 

• Pierpaolo Luzzatto-Fegiz, Op. ciU 
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In sostanza Tostacolo prinicipale di queste ricerche sta nella difficoltd* 
di ordinare le porsone attive di una data collettivit^ secondo il grado 
di importanza che esse hanno nel gruppo stesso, date che questa impor- 
tanza non puo desumersi soltanto dal reddito goduto o dalla professione 
esercitata, ma dal complesso di queste e di altre circostanze. Ma sup- 
ponendo superata questa difficolt^l ed ottenuta una graduatoria anche 
non esattissima, tutte le imperfezioni ed equivoci derivanti dalle defini- 
zioni dei gruppi costituenti il ceto alto o il ceto basso, verrebbero ad 
essere superati; non vi sarebbe infatti necessity, di ricorrervi. 

Si supponga di voter considerare la circolazione sociale nel suo aspetto 
statico; graduate le persone attive componenti un dato gruppo sociale 
secondo la loro importanza, si potr^l procedere ad una analoga gradua- 
zione dei padri di queste persone (o di altro ascendente)^ ed allora potreb- 
be prestarsi assai bene per la rappresentazione e la misura della circola¬ 
zione sociale un procedimento analogo a quello chec si applica per lo 
studio della concentrazione. 

Se, a cominciare dalFalto della graduatoria, si delimitano gruppi 
percentuali sempre piii grandi abbassandone il limite inferiore, si potr^t 
per ciascuno di questi gruppi determinare la percentuale di coloro che 
provenivano da padri (o altri ascendonti) che, nella loro graduatoria era- 
no compresi nello stesso gruppo percentuale.. Per brevit^t indicheremo 
questi col termine di “omosociali.” 



Si riportino sull’asse delle ascisse di un diagratnma cartesiano le per- 
centuali dei singoli gruppi formati nel mode che si 6 detto, e sull’asse 
delle ordinate si riportino le percentuali degU omosociali, come 6 indica¬ 
te nel grafico 1. 

• Pi* esattamento, verrebbero graduati in simile modo i caai d‘t patemiia oioe 
stessi appartenenti al gruppo, ma non pi* in riguardo della loro posiztone sociale, 
ma bensi della posizione sociale del padrp (o di altro ascendente). 
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Con prima approssimazione, ciofe trascurando Teffetto di altre cause 
di perturbazione,® si potrebbc dire che, se la circolazione sociale awenisse 
come in un gioco di sorto, ciofe senza che operino fattori ambientali, 
ereditari o selottivi, a ciascuna frazione delle persona attive considerate 
corrisponderebbe una egual frazione di “omosociali.” Le percentuali di 
questi ultimi verrebbero a disporsi sulla diagonals BC. 

Ma in realtfe, quests percentuali si pongono sopra una linea curva A'C 
pill gollevata, e di tante piu solbvala, quauto minore fe il processo di 
osmosi sociale. La suporficie racchiusa tra la diagonale BC e la curva 
A'C darebbe una misura della occlusione sociale. 

Nel caso limite di totale occlusione, tale superficie risulterebbe oguale 


A'AC 

aU’intero triangolo BAG, sicche il rapporta delle due superfici 

A'BC 

potrebbe darne una misura; mentre il rapporto complement are 
indicherebbe il grado di osm jsi sociale. 

Naturakmente la diagonale BC sarebbe ben lungi dal rappresentaro 
una situazione di ‘‘ottimo.” Anche amesso una ambiente avente una 
plena liberty di circolazione, vi Sarebbero pur sempre circostanze natural! 
ineliminabili come la selezione bioereditaria dei figli dei pife altolocati, 
ed altre circostanze che ^arebbe dannoso eliminare (come la migliore 
educazione e preparazione darivanti da un ambiente familiare pife elevato). 
Tutto cio comporterebbe, pure amessa reliminazione di tutti gli attriti 
di carattere patologico, una forte deviasione del segmento BO v(TSO 
I’alto. • 


Ma non v’fe dubbio che una gran parte della superficie OA'C deriva da 
privilegi eliminabili e dannosi. 

Per tutte le difficolt5- di cui abbiamo parlato i saggi dovuti a privati 
studios! che hanno trattato questo argomento, sono eseguiti in mode 
estremamente grossolano. Per solito si oonsidera un gruppo di persone 
appartenenti all’alto ceto, ma anzichfe determinare qual peroentuale dl 
questo gruppo proviene oppur non da ascendent! che avevano la stesPft 
possizione relativa, si determina la peroentuale di coloro. che provengono 
da un gruppo assai pin ampio, per solito contrapposto a quello dei 
lavoratori manual!. 


8 Con questo metodo non si prende in considerazione qiiella parte del fliisso 
dovuta alia sostituzione di quegli eleraenti che non ebbero prole maachile: attiva, 
Questa eschisione conduce ad una attenuazione nella misura della circolazione tanto 
pih forte quanto maggiore h la frequenza delle persone che rimangono senza dw-. 
cendenti attivi, appartenenti all’ alto ceto, rispetto alia analoga frequenza propria, 
dei ceti pih bassi. Altra causa di deformazione consisterebbe nel cotisiderare la, 
condizione sociale degli appartenenti al gruppo in esame all’eta che essi hanno al 
tempo del rilievo, e considerare invece la posizione sociale dei padri ad una fetA o , ad 
un periodo della yita eguale per tutti. Queste cause di perturbazionO 
eeeere evitate o almono in parte oorrette. > 
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Riferiamo questo tipo di indagini al precedente schema (vedi grafico 2), 
II segmento Afi indica Tampiezza petcentuale del gruppo superiore consi- 
derato; il segmento Aa, Tampiezza del ceto del lavoratori non manual!. 
Poiohfe le singole ordinate indicano la percentuale di coloro che proven- 
gono non gi4 da padri aventi la loro stessa posizione, ma da padri aventi 



una posizionc anche assai piii modesta, la percentuale degli “omosociali” 
si sollevera (dal punto A" al punto A'"), e tanto piii si sollever4, quanto 
pih piccolo 6 il segmento Afi , e quanto pih grande h il segmento Aa. 

Per il fatto che tale percentuale e funzione sia dell’ampiezza che si 
b data al gruppo superiore o direttivo, sia deirampiezza del gruppo dei 
lavoratori non manual!, deriva la equivocit^l e la inconiparabilita di 
questi risultati. Non di mono anche noi, nel breve saggio che sara es- 
posto in seguito, abbiamo dovuto accostarci al comune ed imperfetto 
schema. 

L’ampiezza del segmento Ba pu6 dipendere, non solo dalla definizione 
"che si dette al “ceto medio,’’ ma anche da cause oggettive. E’ ovvio 
che anche se fosse attuabile una perfetta eguaglianza *di definizioni, 
eon questi vecchi schemi di indagine si otterrebbero risultati ben diversi 
a secohda che si tratti di paesi in cui il ceto manuale e, relativamente, 
pih o meno frequente. 

Non crediamo pero che le difficoltli. che si frappongono alia esecuzione 
di rilievi del tipo che abbiamo sintetizzato nel grafico 1, siano insuperabili. 

Non b certamente questo un compito che possa essere assunto dalla 
Statistica ufficiale, sarebbe pur molto gravoso per privati studiosi. Ma 
Tesistenza di Enti che operano col metodo dei sondaggi renderebbe 
possibiie Tesecuzione di indagini del tipo che suggeriamo* Sebbene 
ia graduatoria che si dovrebbe formare (sia per le persone costituenti 
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il campione, sia per gli ascendent! di queste) sarebbe pur sempre affetta 
da element! soggett!v! ed arb!trari, queste indagm! darebbero r!sultati 
assai p!ti complet! e soddisfacent! !n confronto d! quell! di oui disponiamo 
al presente. 

Queste ricerche hanno preso in ogg! lin interesse eccezionale anche 
per ! riflessi politic! del problema. Come nel campo della produzione 
si hanno sistemi di economia pianihcata, e di economia di concor- 
renza, cosi neirimpiego delle capacity individuali si attuano o si vorreb- 
bero attuare sistemi di circolazione pianificata o di circolazione libera. 

Nel primo sistema il passaggio ai posti piu alti dovrebbe avvenire 
sotto il controllo dello State; nel secondo sistema esso si verifica in modo 
spontaiieo. Nel primo la selezione b fatta dallo State stesso con una 
scelta che si inizia dall’et^ scolastica; nel secondo la selezione b affidata 
alia libera concorrenza. Ma b ovvio che tanto nel caso della circola¬ 
zione libera quanto nel caso della circolazione pianificata, si verificano 
o si possono verificare circostanze che ne attenuano il valore sellettivo. 

E’ ben noto che nei paesi a circolazione libera queste circostanze 
sussistono e sono di carattere ambientale ed economico; ma nessuno si 
e ancora avvicinato a darne una misura. Nei paesi a base comunista 
sarebbe poi da indagare se i criteri selettivi che si adottano sono i mig- 
liori, o se, nel corsd del tempo non vengano a riformarsi dei previlegi 
particolari. 

A tutti questi interrogativi dovrebbe dar risposta la Statistica con 
indagini approfondite. Nei paesi democratici queste indagini dovreb- 
bero essere preliminarmente dirette a valutare il volume di questo flusso 
e a precisare le vie che gli “homines novi” seguirono nella loro ascesa. 
dob se furono formati principalmente dalla scuola o dalla pratica. Si 
dovrebbe poi indagare sull’ esistenza e sul grado della selezione eredi^ 
taria e sugli effetti anti selettivi dell’ambiente. 

L’idea che in uno State progredito tutti i posti di direzione e di res- 
ponsabilitlb debbano essere occupati dai pih capaci, indipendentemente 
dalla loro origine sociale, b accolta come prinoipio indiscutibile ed b 
anche afifermata come un diritto. 

Ma la generality giudica questo colossale problema in base al falso 
presupposto che la via maestra della elevasione sociale sia quella della 
scuola superiore. Sicoh4 la soluzione starebbe tutta neirofFrire ai giovani 
dei ceti pih bassi quelle stesse possibility di accedere agli alti gradi deir 
istruzione che sono ofFerte ai figli delie persone pih altolocate. 

Se si guarda soltanto a quello che accade neirambito universitario 
si pub avere I’impressione che la circolazione sociale, nei paesi in cui 
il flusso di rinnuovo b rimesso prevalemtemente aU’azione della libera 
concorrenza, incontri ostruzioni quasi proibitive. Infatti in Italia, 
come a un dipresso negli altri paegi occidentali d’Europa, la proporzione 
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dei nuovi laureati aventi il padre di condizione operaia o assimilabile 
all’operaia, 6 circa del 12% del totale; e se si potesse poi calcolare la 
proporzione di coloro che, ottenuta la laurea, proseguono nell’ascesa 
per raggiungere posizioni di riguardo, si troverebbero certo ben pi(i 
piccole percentuali. 

Ma le cose stanno in modo ben diverse da come sono viste dalla gene- 
ralitlt, forse domiata dal prestigio che circonda Talta cultura. Oggetto 
principale di questa memoria 6 quello appunto di dimostrare, sebbene 
con piccolo saggio statistico, che la circolazione sociale non jassa che in 
piccola parte dalla scuola universitaria, e che il suo volume, rispetto- 
alla totality del ilusso di rinnuovo, h almeno triple di quello che appare 
considerando soltanto Torigine familiare dei nuovi laureati. 

Tutto questo ha un notevole interesse anche pratico poich^ se per 
iniziativa dello State si vuole fare qualche cosa di utile occorre avere 
una idea meno imprecisa di quanto avviene in realta e favor ire quelle 
forze che gi^ sono in atto spontaneamente. 

Per questa indagine abbiamo preso le mosse da uno spoglio dei nomi 
delle persone di sesso maschile appartenenti ai consigli di amministra- 
zione di Society per azioni che esplicavano attivita industriali e commer 
ciali® e che nel 1939 avevano un capitale sociale non inferiore ad 
1,000,000 di lire.io 

Abbiamo classificato quest! nominativi secondo chfe risultavano, 
oppur no, in possesso di una laurea o di altro titolo equipollente, distin- 
guendo pure tra gli uni e gli altri quelli che risultavano iscritti nell’ albo 
della “Nobilta.” 

Non ci siamo sobbarcati al gravoso lavoro della eliminazione dei dupli- 
cati che. sono frequentissimi.^^ Ma, come si vedra, tale omissione non 
impedira di trarre dalle cifre raccolte conclusion i s’.cure, sebbane generiche. 

» Piii preoisamente abbiamo considerato lo industrie estrattive, metallurgiche, 
meccaniche, elottriche, tessili, deirabbigliamento o del cuoio, del legname, degli 
agglomeranti, laterizi, ceramica, vetro, alimentari e della pesca, della carta e poligra- 
fiche, commerciali (grandi magazzini, commorcio all’ingrosso, importazione e espor, 
tazione). 

Abbiamo utilizzato per tale spoglio il volume: Le Societa IMiane per Azioni — 
Notizie Stoti^stiche, Edito dalla Ass. Ital. fra le Soc. per Azioni; ed. XVI, Roma, 
1940. 

Abbiamo riparato almeno in gran parte alle rare omissioni dei titoli professional! 
e nobiliari con la consultazione di altri annuari e dizionari biografioi. Per titoli 
equipollenti alia laurea abbiamo considerati quelli di Uflficiale superiore dell’Eser- 
cito, deU’Aviazione o della Manna; nonch6 la generica indicazione di “Professore*^; 
criteri questi volutamente assai larghi che abbiamo adottato anche a compenso delle 
poche eventual! omissioni. 

Vedi P. Luzzatte-Fegiz, “Il consiglio di amministrazione e Tinterdipendenza 
delle imprese,** Il giornale degli Economisti, Marzo 1928. 
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Biportiamo anzitutto i riaultati complessivi dello apoglio: 

Laureati.4,518 

Non laureati.4,959 

TOTALE...9,477 

I nomi di persone aventi titoli nobiliari si distribuivano invece nel 
mode seguente: 

Laureati.296 

Non laureati.187 

TOTALE. 483 

Queste cifre benchfe diraostrino la notevole frequenza di non laureati 
tra le persone che bccupano elevati posti di comando nelle industrie 
e nei commerci, non dicono ancora nulla circa la entit^t della circolazione 
sociale, perchb ovviamente, e come la stessa distribuzione dei “nobili” 
dimes tra, una gran parte dei non laureati deriva da famiglie gi§i stabiliaz- 
zate nel ceto superiore. Nondimeno esse ci danno la possibility di 
accostarci ad una valutazione di detta circolazione. 

Abbiamo giy detto tra i giovani laureati la proporzione di quelli pro- 
venienti dal ceto degli operai manuali b circa del 12%. Questo ci con- 
sente di afFermare che sul totale dei laureati qui considerati (4,518) 
vi deve pur essere una frazione, non certo eguale, ma pur apprezzabile, 
di element! sorti dal ceto operaio. Attenendoci ad una proporzione del 
6% in luogo del 12%, non erreremo probabilment di molto. Avremo 
quindi: 4,518 X 0.06 = 271. 

Poichfe sappiamo che i laureati provenienti dal ceto nobiliare erano 
296, si puo dire che: 4,518 — (271+296) = 3,951, indichi il numero dei 
laureati provenienti da famiglie giy appartenenti al ceto medio. E 
se poi vogliamo ammettere che in questo ceto il rapporto dei non laureati 
rispetto ai laureati sia quello stesso che si rinviene nel ceto nobiliare 
(63’18%) si deve concludere che ai 3,951 laureati originari del ceto medio, 
devono corrispondere circa 3,951 x 0.6318 — 2,496 non laureati di 
eguale origine. 

Abbiamo cosi tutti gli element! per riempire la seguente tabella: 


Tabblla 1 

Italia, 1939: Distribuzione ipotetica dei Consiglieri dei Amministrazione di Society 
per Azioni aventi un milione o piii di capitale sociale, secondo il ceto sociale di pro- 
venienza ' 


Ceto di provenienza Laureati Non laureati Totale 


Nobiliare 

Borghese 

Operaio o assimilato 



TOTALE 


4,518 


4,957 


9,475 
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Da questa sfuocatissima impressione statistica risulterebbe cbe la 
precentuale degli “homines novi” sarebbe del 26.9%. Ma affinando 
il rilievo avremmo trovato una perentuale molto pih alta poich6 tutte 
le principali cause di perturbazione che infirmano questo rilievo relativa- 
mente al fine che si prefigge operano nelP abbassarla. 

Infatti nel ceto borghese stabilizzato da almeno due generazioni ed 
occupante posti direttivi la frequenza dei non laureati rispetto ai laureati 
deve ritenersi pih bassa di quella che si rinviene nel ceto nobiliare. 

Si deve anche tener presente che la concentrazione dei seggi consiliari 
nelle stesse persone e verosimilmente di gran lunga minore per gli 
“homines novi” in confronto di tutti gli altri. 

Inoltre tra i nobili, e specialmente tra i nobili non laureati, vi sono 
uomini il cui passaggio al ceto superiore fe recentissimo. 

Si deve infine tener presente che la predetta percentiiale del 26.9 ri- 
guarda un fenomeno di stato e non di wovimento. non riguarda cio^ la 
composizione del flusso, ma la struttura del gruppo colta in un dato 
istante. Nel flusso di rinnuovo la percentuale degli “homines novi“ 
e certamente maggiore di quello che si rinviene nella massa, e questo 
per un complesso di ragioni sociali e demografiche che ogni statistiche 
intuisce. 

Naturalmente deve supporsi che tale percentuale sia piu bassa nella 
parte pih elevata di questo settore, ciofe che decresca col crescere coll’ 
importanza del capitale sociale. Ma dobbiamo anche rifiettere che 
il nostro rilievo non coglie, nelle attivit^ che abbiamo considerate, che 
una parte degli imprenditori, quella parte ciofe che esplica tale attivit^t 
nella forma meno personale delle Societa per Azioni. In tutte le altre 
numerose aziende oltrepassanti il limite di importanza posto in questo 
studio cd aventi carattere personale o un’altra figura giuridica, la per¬ 
centuale esprimente il volume della circolazione sociale sarebbe risul- 
tato, per ragioni intuitive, assai piu forte. 

Dobbiamo piuttosto riconoscere che in questa indagine non sono chia- 
rite le caratteristiche qualitative di questa circolazione, non e precisato 
cio^ se si tratta solo di figli di persone che esercitano profession! manu¬ 
al! o assimilabili ad esse, oppure se comprendono anche element! la 
cui posizione superiore non ^ cosi recente. 

Tutto pero fa credere che la circolazione sociale costituita da passaggi 
di 1® e di 2® grado sia in questo settore almeno tripla, nella sua impor¬ 
tanza relativa, di quella che passa per la scuola universitaria. 

Ma la nostra modesta ed imperfetta indagine dice qualcosa di pih 
edi piii esatto. 

Avendo distribuito i consiglieri laureati e non laureati combinata- 
mente secondo le varie attivitit industriali o commerciali, e secondo I’al- 
tezza del capitale sociale, siamo in grado di vedere le linee di maggior 

63 
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pcndenzfl* per le quali la schiera degli uomini nuovi irromp© nel ©©to 
superior© degli imprenditori, per poi dilagar© nelle altr© generazioni 
per t'utto il complesso. 

La tabella 2 riporta, in cifre assolute e proporzionali, questa distribu- 
zione combinata. Si rileveret da questa tabella ©he la percentuale d i 
“non laureati” e massima per quei gruppi industriali per i quali susisto 
un numeroso artigianato (abbigliamento, tessili, alimentari) e ©he assume 
i valori piu pic©oli per quei gruppi di attivita in ©ui questo artigianato 
ha proporzioni minime (industrie elettriche, estrattive). 

Se si raffronta poi la frequena dei “non laureati” dei vari gruppi, ©on 
quella degli esercizi artigianali rispetto al totale degli esercizi, o degli 
addetti in esercizi artigianali rispetto al totale degli addetti, secondo 
lo risultanze del censimento industrial© del 1937-40^^ si notera una forte 
concordanza positiva tra la prima e le altre due serie: 


Tabella 3 

Fregiienza dei Coiisiglieri non Laureati nelle maggiori societa industriali, e fro- 
quenza degli osereizi artigianali o degli artigiani nelle rispettive categorie industriali 


Categorie industriali 

consiglicri 
non laureati 

artigiani e 
dipendenti in 
percento 
del totale 

Esercizi 

artigianali 

Elettriche . 

26.0 

0.0 

0.0 

Estrattive . 

37.2 

0.0 

3.3 

Meccaniche . 

41.3 

20.3 

95.0 

Carta e Poligrafiche ... 

42.7 

9.2 

50.3 

Metal lurgiohe . 

44.4 

0.0 

0.0 

Agglomeranti, Laterizi 
Ceramica Vetro 

56.1 

14.2 

68.3 

Legno e affini . 

58.0 

63.5 

93.8 

Alimentari e Pesca ... 

59.6 

32.1 

58.8 

Tessili . 

68.4 

5.8 

74.2 

Abbigliamento, Cuoio, 
pelli . 

70.9 

74.9 

98.2 


Tutto questo ci fa intendere che lo linee di maggior pendenza per le 
quali scorre il flusso vivificatore di rinnovazione sociale passano per 
quelle attivitft, in cui, anche storioamente, I’azienda familiare si svilupa 
nella piecola e poi nella media e grande impresa. 

La scuola superiore in tutto questo movimento non ha dunque che 
una parte seoondaria. La maggioranza dei giovani che ne superano 

» I dati sono riprwi dal Vol-1, Induatria, Parte 1. Esercizi, Addetti, fbrza 
jj^otrice. 
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il vaglio non raggiunge poi una posizione sociale parificabile per pres- 
tigio e per reddito a quella che raggiungono, forse piii facilmente, coloro 
che superando il vaglio della pratioa professionale salgono alia direzione 
di impresse industriali e commerciali, di media o anche di piccola impor- 
tanza. 

L’esperienza fa anche temer’e che la proporzione dei laureati che sos- 
tano e languono in basso sia maggiore tra coloro che provengono dal 
ceto dei lavoratori manuali, che non quelli che provengono dal ceto medio. 

Poich6 fe credibile che molti, per funesto equivoco, tendano airuni- 
versit^l o vi siano avviati non per le loro attitudini o tendenze spiritual!, 
ma solo perchfe si vede neiruniversitlb un mezzo di elevazione economica 
e sociale. 

Per il presente almeno, se si vuol veramente favorire il process© di 
circolazione dal basso airalto, in modo che all’alto salgano i pih merite- 
voli conviene sopratutto favorire quelle forze che piu occultamente, 
ma pur tanto efficacemente, sono gia in azione. 

Percio, nel campo dell’istruzione, le maggiori cure per raggiungere 
questo fine non vanno indirizzate verso la scuola superiore, ma bensi 
verso la scuola media professionale e specialmente verso quella pih bas- 
sa, affinchfe questa istruzione venga a favorire sempre di pih coloro che 
per il filone della pratica, e dopo il vaglio della selezione professionale, 
debbono vincere la concorrenza degli altri pih favoriti dairambiente. 

Concludiamo con Taugurio che queste ricerche sul volume della cir¬ 
colazione sociale, e sulle vie principali che essa segue, siano ripresi ed 
approfondite. 

Certo come dicevamo, la Statistica ufficiale non sembra molto adatta 
ad eflfettuare rilievi de carattere cosi delicato, A1 contrario quest! rilievi 
possono essere compiuti, ci sembra, da quelle organizzazioni che hanno 
per scopo Feffettuazione di inchieste col metodo dei campioni. 

Il nostro Istituto potrebbe prendere I’iniziativa per favorire queste 
richerche e convogliarne Teffettnazione in un quadro uniforme, 


Resume 

It is desirable that representative inquiries should be made, so as to 
obtain as complete information as possible with regard to: 

a) the quantitative importance of social mobility; 

b) the lines it follows; 

c) its degree of selection. 
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The International Statistical Institute might develop a very useful 
action with the object of promoting these inquiries in an organic setting 
and of reducing the incomparability caused in such studies by the com- 
plexity of the phenomenon and the ambiguous character of various 
nations. 

The author exposes certain results of a statistical study which he 
made in this field. These results are of particular interest in regard 
to the item h mentioned above. 

In Italy the number of graduates whose fathers belong to the labouring 
class amounts to about 12%; the same proportion has been found in other 
countries of Central and Western Europe. 

It is probable that almost all sons of workmen who get higher educa¬ 
tion (diflFerent from the others) will occupy posts for which a university 
degree is required. So it may be presumed that in these functions the 
influx of new men is rather strong. But the more important question 
is to know the proportion of the new men occupying important 
functions for which no university degree is required. 

The author has endeavoured to get an idea of the situation in this 
respect for a group of industrial employers more precisely the members 
of the board of directors of limited liability companies, the social capital 
of which was at least a million lire in 1939. 

The source of data used for this purpose permitted to distinguish 
those who had obtained a university degree from those who had not and 
those who had a nobiliary title from the others. By conjecture, this 
information has permitted to conclude that among the people under 
consideration, the proportion of new men would be considerably higher 
than 27%. 

The rate of persons without university degree decreases with increasing 
social capital. For each size of firm (according to the social capital), 
the proportion of persons without university degree is highest in the 
clothing and leather industries; this proportion is likewise rather high in 
the textile industry; it falls in metallurgy and the mechanical industry, 
and reaches a minimum in mining. 

Thus it may be concluded that in the class of leading industrialists 
the rate of new men is higher for those industries having their basis 
in the small scale home-industry. 

It is unfortunate that only such limited sources of data are available 
for research work in this field. Official statistical agencies do not seem 
to be the most suitable for making the necessary enquiries, as the ques¬ 
tions to be asked are very delicate. This might be more satisfa^ctorily 
undertaken by organisations engaged in public opinion research, and 
sample surveys in general. 
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The International Statistical Institute might take the initiative of 
promoting such inquiries on a uniform basis. 


R^sumi 

II semble desirable que des enquetes representatives soient faites 
de fa 9 on k obtenir des renseignements aussi complets que possible sur: 

a) Fimpoitance quantitative du mouvement de capillarite sociale, 

b) Les voies qu’il suit, 

c) son degre de selection. 

LTnstitut International do Statistique pourrait developper une 
action trfes utile, ayant pour but de favoriser ces enquetes dans un cadre 
organique et de reduire I’incomparabilite que la complexit6 du phenoJnene 
et le caractfere equivoque des definitions causent dans de telles etudes. 

L’auteur expose certains resultats tires d'une enquete qu’il a faite dans 
ce doraaine. Ces resultats oftrent de I’iuteret surbout pour ce qui se 
rapporte a I’importance dos dherses voies suivies par les mouvements 
de capillarite sociale. 

En Ttalie, les laureats ayant un pfere ouvrier (ou de situation similaire) 
ont k peu prfes, parmi tous les laureats, la proportion de 12%: la meme 
proportion qu’on a relevee en d’autres pays de TEurope Centrale ou 
Occidentale. 

II est vraisemblable que les fils d’ouvriers qui frequentent les ecoles 
superieuros sont, presque tous (4 la difference des autres) achemines vers 
les professions ou les emplois pour lesquels un dipldme universitaire est 
necessaire. Pour cela on doit supposer que dans ce^ professions Tafflu- 
ence des ‘‘hommes nouveaux” soit assez forte. Mais la question la plus 
importante est de savoir quelle est. la proportion des “hommes nou- 
veaux” exer 9 ant des fonctions directives dans les activites pour 
lesquelles un diplome universitaire n’est pas necessaire. 

• L’auteur a t&ehe d’approcher la realite pour un groupe d’entrepreneurs 
de Findustrie, plus precis6ment lesmembres des conseils d’administra- 
tion des societes par actions dont le capital social, en 1939, n’etait pas 

inferieur k un million de lires. 

♦ 

La Qoqrpe utili^ d. cot eftet permettait de distinguer parmi eux, coux 
qui avai^nt obtwiu un dipldme univemtaire, de ceux qui ne I’avaient 
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pas, et ceux qui possMaient un titre nobiliaire, des autres* Par conjec¬ 
tures, ces donnees ont permis d’affirmer qiie dans le total des unites 
consider^es, la proportion des ‘‘homines nouveaux” serait sensiblement 
sup6rieuro k 27%. 

On constate que la proportion des personnes sans diplome universi- 
taire diminue d’autant plus que le capital social est eleve.. Dans toutes 
classes de capital social, la proportion des personnes qui n’ont pas de 
diplome universitaire est la plus forte dans ]’Industrie du vetement et 
du cuir; cette proportion est de m6me assez forte dans Tindustrie textile; 
elle se reduit dans la metallurgie et la m^eanique, et elle atteint le minimum 
dans I’industrie miniere et electrique. 

On peut conclure de cela que, dans la classe de grands entrepreneurs 
industriels, la proportion des “hommes nouveaux” s’el^ve d’autant plus 
que la grande Industrie a, ^ sa base, la petite Industrie a caract^re 
familier. 

T1 est penible quo les savants qui se consacrent a ces recherches soient 
obliges d’utiliser des sources si limitees. 

D'ailleurs, la statistique officielle ne semble pas la plus adaptee a 
effectuer les releves necessaires, dont les questions a poser sont tres deli- 
cates. Ces releves peuvent mieux etre faits, nous semblo-t-il, par les 
organisations de recherches de Topinion publique, et, on general, d’cn- 
quetes par la mcthode des sondages. 

L’Institut International de Statistique pourrait prendre Tinitiative 
de favoriser ces recherches ot d’en diriger Taccomplissement sui\ant 
un cadre uniforme. 



COST OF LIVING, SALARIES, CONSUMPTION AND 
THE SITUATION OF THE ITALIAN 
MIDDLE CLASSES 

by Guglielmo Tagliacarne 
Italian General Federation of Commerce 

I 

1. The Increase in Living Costs 

During the first years of the war it was possible to keep the cost of 
living within reasonable limits; but towards the end of the conflict prices 
began to soar rapidly and after the armistice they increased even more 
rapidly. In fact, by the end of 1943 the index of the cost of living was 
times that of before the war; at the end of the following year it had 
risen to 12 times the prewar; by the end of 1945 it was up to 25 times; 
and at the end of 1946 the index was 39 times that of the period prece¬ 
ding the conflict. Now (May 1947), prices are 50 times the 1938 level. 

Not all the prices of the various items that go to make up a family 
budget have increased to the same extent. The cost of food has increa¬ 
sed 67 times, of heat and light 22 times, while sundry expenses have in¬ 
creased 24 times. Rents, however, were as of May 1947 only 2^ times 
those of 1938.1 

If total consumption had remained unchanged in both quantity and 
quality, compared to 1938, the different increases in the prices of the va¬ 
rious items of the family budget would have increased the percentage 
of the budget going for food, raising it from 51% (average for 1938) 
to 67% (May 1947) of the total budget. This means that, while in 1938 
expenses for food absorbed little more than half of the total amount 
spent by a working family, today two-thirds of all family expenditure 
would be required to make the same purchases. Clothing expenses, 
from requiring 17% (1938) of the total expenditures, would now (May 
1947) require 26%, The part going for rent, which had been approxi¬ 
mately equal to that fixed for clothing, i.e., 16% of the total, appears 
to have fallen to a negligible consideration, to less than 1 % of the total.® 

» In Italy various series of index numbers are being calculated to express the 
cost of living, with results that differ notably one from another. This is due not 
only to the different methods employed in the calculations but to the irregularity 
of business transactions and the difficulty in obtaining reliable statistical reports 
especially because of the many products apd articles bought on the black market. 
The data referred to in this text are based on an average of three indices obtained 
from the followng three sources: (1) Economic Service of the Montecatini Cc*., (2) 
Technical Committee of the Edison Group, (3) National Index of the Central Ins- 
titute of Statistics. 

» These figures are based on the cost of living indices drawn up by the Edison 
Group. 
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Expenses for food, however, have absorbed much more than the above- 
mentioned quota of 67%. As was pointed out, this percentage is based 
on the hypothesis that total consumption in both quantity and quality 
has remained the same as before the war. But, actually, the sharp drop 
in incomes did not allow the population to maintain the prewar stan¬ 
dard of living; it was forced to make sacrifices with consequent restric¬ 
tions in its habitual consumption. 

Obviously, reductions can be made more easily in the sectors least 
indispensable, while it is especially impossible to reduce in any great 
measure the consumption of foodstuffs. This was the case in Italy 
where food consumption was already quite low even before the war. 
Expenditures for food today, therefore, demand not 67% but at least 
75% of the family budget. Clothing expenses have decreased to the 
point where they now probably absorb not more than far less than 

the above-mentioned 26% requirec! had 1938 consumptioii been main¬ 
tained. 

2. The Increase in Public Service Costs and Taxes 

It is interesting to examine the changes in cost of the most important 
public services and certain articles and products as compared to the 
price changes of food and clothing. The indices of some of these items 
are as follows: 

Table 1 

Representative Costs, May 1947—Milan or Rome 
(1938 cost -- 1) 


Gas fcr cooking—Milan 15 

Electricity for lighting (with meter)—Milan 7 

Water—Rome -1 

Daily newspaper 33 

Subscription for radio broadcasts 12 

Doctors’ foes—Milan 20 

Postage stamps 12 

Railroad fare (3rd class, 100 kilometers) 8 

Trolley fare (non-holiday)—Milan 14 

Taxi fare—Rome 35 

Haircut — Rome 15 

Public telephone 10 

Movies—Rome 20 

Theatre—Rome 10 

Tobacco (controlled price) 14 

Direct taxes ^ 

Average expenses for food 87 

Average expenses for clothmg 69 

Over-all cost of living 60 


Sources: Technical Committee of the Edison Group; UNRRA; Central Institute of Statistics. 
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It is readily seen that the increases in service prices are much smaller 
than those in prices of food, clothing, and the over-all cost of living. 

3. Official Prices and Black Market Prices 

Though the Government fixes official prices for a large number of 
rationed items, in practice large additional quantities of these items 
are sold at much higher prices on the black market. 

The fcRowing examples for a group of food products which are con¬ 
sumed on a large scale in Italy give an idea of the difference existing 
between the two prices: 


Table 2 

• Comparison of Official and “Black Market” Retail Prices 
Rome, May-June 1947 


Bread 

Pasta (spaghetti, etc.) 

Rice 

Bacon 

Olive oil 

Sugar 

Maize flour 


* Lire per kilogram 


Official 

“Black Market 

34 

195 

53 

278 

65 

242 

510 

950 

355 

838 

165 

813 

27 

70 


Source: Rivista del Cwnmercio, 1947, No. 3. 


4. Prices Based on Caloric Values 

It is also interesting to examine the prices of food products in terms 
of their caloric values. From this point of view one can divide food pro¬ 
ducts into low-priced and luxury foods, the first category including 
cereals, the second including especially meat. Butter also is relatively 
expensive as compared to olive oil, which can be used in its place. 

Table 3 

Cost of 1,000 Calories of Various Foodstuffs 
Free market, Roma- June 1947 



Lire 

Wheat flour 

52.24 

Maize flour 

19.14 

Home-made broad 

71..32 

Pasta 

73.57 

Rice 

68.70 

Beans 

60.00 

Lentils 

56.46 

Bacon 

107.32 

Butter 

130.37 

Olive oil 

92.96 

Sugar 

198.17 

Meat 

1,000.00 


Source: Calculated by the author on the basis of the caloric values of these products as 
estithated by the Institute of Nutrition of the National Research Council (Rome). 
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A diet consisting only of poknM (a pudding made with maize flour) 
would be anything but health since polenta does not contain all the nutri¬ 
tion elements necessary to the human body; but apart from this one 
could say that 57.42 lire a day (800 grams of maize flour) would suffice 
to give an active man the 3,000 calories indispensable to him (expenses 
for cooking and salt should be added). 

For similar reasons a diet of meat alone is no more advisable than one 
of only polenta. Furthermore, it is expensive indeed. A diet consist¬ 
ing exclusively of meat would mean a daily expense of 3,000 lire to 
provide the 3,000 calories required by an active man. In other words, 
a meat diet is 52 times as expensive a diet of polenta. 


5 , Comparison between the First and Second Wori.d Wars 

A comparison between prices after this war and those after World 
War I can be drawn by examining the indices of the cost of living in 
Milan; let us begin for World War I with January 1919 and for the second 
with July 1945. 

Immediately after the end of the first conflict the indices of the cost 
of living decreased and by July 1919 they were down 23%. Later, 
prices began to rise so that by December 1919, one year after the end 
of the war, the cost of living was back to its January 1919 level. 

In this second postwar period prices have followed a somewhat dif¬ 
ferent pattern. Frincijially, there was no time following the conflict 
during which prices actually dropped; instead, there has been a conti¬ 
nuous increase, an increase which was moderate during the first postwar 
year but which subsequently turned into a situation in which prices 
soared rapidly. 

In both the first and second postwar periods, the most serious increa¬ 
ses in the cost of living started in the second year after the end of hostili¬ 
ties. Obviously, this . comparison between prices then and now can be 
presented only as.indicative since there appears to be no valid reason for 
believing that .prices during the two postwar periods should necessarily 
follow the same pattern. 

The greatest difference in the trend of prices during the two periods 
is to be found in the extent of the increases. 
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Table 4 

Indices of the Cost of Living in Milan 



World War I 


World War II 


(1914 == lOO)* 


(1938 

= 100)»» 

1919 

January 

35.S 

1946 July 

1,802 


April 

331 

October 

2,415 


July 

271 

1946 January 

2,433 


August 

288 

February 

2,429 


September 

302 

Marcli 

2,686 


October 

323 

April 

2,636 


November 

348 

May 

2,529 


December 

352 

June 

2,609 

1920 

January 

378 

July 

2,652 


February 

382 

August 

2,817 


March 

374 

September 

2,804 


April 

392 

October 

3,123 


May 

438 

November 

3,430 


Jime 

448 

December 

3,868 


July 

441 

1947 January 

3,919 


August 

449 

February 

3,842 


September 

470 

March 

4,246 


October 

489 

April 

4,613 


November 

511 

May 

4,030 

1921 

J anuary 

671 1 




February 

566 




March 

568 

1 ♦ Source: Annuario atorico-statistico of the Municipality 


April 

678 

of Milan. 



May 

678 




Jime 

506 

** Source: Economic Service of the Montecatini Co, 


July 

494 . 




Let us extend our comparison to the various items included in a family 
budget. Two years after the end of each world war the various items 
of a family budget were represented by the following numerical indices: 



First World War 

Second World War 


December 1920 

May 1947 


(1914 == 100)« 

(1938 = 100)^ 

Food 

635 

6,682 

Clothing 

782 

6,932 

Rent 

139 

261 

Heat and light 

886 

2,228 

Simdry expenses 

604 

2,438 


• Source: As in Table 4. 

« Source: Average of three indices, Montecatini CcEdison Group, and Cen^ 
tral Institute of Statistics. In Table 4 only the indices drawn up by the Monte<^ 
catini Co. were used because those of the Edison Group and the Central Institute, 
of Statistics begin at a more i*ecent date. 
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6. The Reduction in the Purchasing Power of Wages 

As was to be expected, wages also tended to increase in an effort to 
keep pace with the rise in prices and cost of living. 

The first step in this study is to compart the rise in wages with that 
in the cost of living. Tn the course of this survey we shall find that 
the situation differs for the various categories of wage-earners and we 
shall have to distinguish between the various cases, limiting ourselves, 
however, to typical examples so that we shall not lose ourselves in 
a long account examining all occupations and the hierarchy of 
categories. 

For the comparison which we arc about to make we shall adopt as 
our base the average of the three indices of the cost of living which we have 
used before; according to this base the cost of living in May 1947 w’as 
about 50 times that of 1938. 

As of this month the w^ages of an unskilled laborer, instead of the 50- 
fold increase required to keep pace with the increase in the cost of living, 
had increased only 36 times; the wages of a skilled workman increased 
26 times, the salary of a second class employee 19 times, of a first class 
technician 13 times, and of an executive 12 times (Source: p]conomic 
Service of the Montecatini Co.). 

Some important observations are immediately obvious: 

a) the increase in the cost of living has been greater than the increase 
in wages; 

fj) this divergon(*y becomes greater as one moves up the scale from 
the grades of unskilled to those of skilled labor, salaried personnel, and 
finally executive class; 

c) the percentage increase in the wages of unskilled laborers has 
been three times that of executives; 

d) real wages, i.f., wages in terms of their purchasing power, have 
decreased, compared wdth 1938, 24% for unskilled labor, 46% for skilled, 
60% for second class employees, 70% for technical first class employees, 
and 72% for executives. 

While, therefore, the unskilled laborer has succeeded in keeping his 
standard of living from being very greatly reduced the same cannot be 
said of workmen and office workers in the higher categories. The pheno¬ 
mena resulting from this notable shrinking of economic distances con¬ 
tinue to be far-reaching and resultant of consequences of the greatest 
importance, 
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The above-mentioned trend in wages paid by private firms is even 
more marked for state and public service employees (see figure 1). 



Figure 1 

TWs fan * of wages, moderatey spread out before the war, has been 
contracting more and more with the worsening inflationary situation and 
the rise in the cost of living, until it threatens to close completely. 

7. Effects of the Equalizing of Wages 

The trend toward equalizing of wages among the various grades of 
labor has resulted in a real displacement of the middle and intellectual 
classes. Already the effects of this phenomenon can be seen, effects 
partially favorable and partially unfavorable. 
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National income, it will be remembered, has decreased 35 to 40% as 
compared to 1938. Even then it was certainly not high. If this 
decrease had been uniformly distributed among all classes, the conditions 
of the lowest categories of workers would quickly have fallen below 
the starvation level, and their health, resistance, and capacity for work 
would have suffered greatly with serious consequences for the whole of 
society. Instead, the leveling of salaries suffered by the upper incomes 
was not, in general, drastic enough to undermine their health or their 
working powers. From this i)oint cf view no noticeable damage is felt 
by society, while under the first case the consequences would have been 
far-reach*ng and serious. 

As a result of the equalizing of wages, consumption becomes modified 
at the expense of luxury goods or at least of those goods which are of 
less universal demand, being directed instead to those more common 
and standardized goods that are manufactured at a lower cost. 

Another effect of the equalizing trend will be that the numbers in the 
intellectual classes will tend to decrease, partly because their years of 
preparation are not being recompensed and partly because they lack 
the means for continuing their studies and for dedicating the years 
necessary to the training for a profession. 

The worsening of the living conditions of the middle classes (which 
include white collar workers, the large majority of the independent 
professionals, artisans, merchants, small and medium land-owners) as 
a result of the drastic reduction of real incomes has forced the heads 
of families to resort to the supplementary work of members of their 
families. 

The situation also has its repereussions on the relations betw^een state 
employees and the State, of the quantity and quality of the work of the 
employees and consequently on the complex problem of bureaucracy. 
State and public service employees receive salaries which are inadequate 
in terms of either the cost of living or their social standards. As a result 
they take on positions hostile to or in contradiction with the authority 
of the State; they are often forced to accept supplementary work in 
their spare time. 

The lowering of real wages to the level of that of the most modest 
and most unskilled worker cannot but have a harmful effect on the sense 
of hierarchical discipline between the various grades of w^orkers. 

Finally, one must consider the effect of this wage equalization trend 
on the accumulation of savings. It is well known that in normal times 
the middle classes are the largest contributors to the various forms of 
savings and therefore supply a large part of the funds which eventually, 
through banks, etc., find their way into productive activity in industry 
and commerce. The grave economic situation in which these classes 
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now find themselves certainly does not allow them to continue these 
habits. On the other hand the more favored categories of workers have 
not yet acquired the savings habits. It should also be pointed out that 
in times such as those we are examining, characterized by rapid inflation 
and an even more rapid increase in prices, saving habits are certainly 
not encouraged. 

HI 

8. Availability of Food 

Following the exceptionally poor 1945 harvest in cereals and other 
agricultural products, the situation in 1946 improved notably allowing, 
with the help of a substantial UNRRA contribution, a moderate increase 
in food consumption. Italy’s dependence on foreign countries for food 
had been gradually decreasing before the war; from 16% in 1922 (79 
kilograms per peon) rsit had bedn reduced to 3.3% (19 kilos per person) 
in 1938 without any reduction in the total amount of food available for 
consumption, which in those years amounted to 576 kilos of food products 
per person.*’' 

In 1946 the amount of imported food products totaled 1,793,073 
quintals, equal to 39 kilos per inhabitant (exactly double the amount 
imported in 1938) which means that in 1946 Italy brought in 9% of her 
food from abroad. 

Despite the fact that the percent of foodstuffs imported had increased 
over the prewar period, the quantity of food available to each inhabitant 
diminished. In the 1933-38 period their diet contained nutritive elements 
yielding 2,500 calories daily while in 1945-46, even with increased im¬ 
portation they received only 1,520 calories. In 1946-47 the availability 
of calories received a substantial, boost; and, although definite figures 
for that year are not yet available, it can be estimated that the average 
per capita intake of calories increased to more than 2,000. 

But although it has increased in the last year, the average diet in 
Italy is still 20% below the prewar level. What makes matters worse 
is the fact that its nutrition value has become poorer since it is largely 
composed of foodstuffs of vegetable origin. In fact, in the years 1933-38, 
78% of the Italian diet was of vegetable origin and 22% of animal; in 
1945-46 animal products had fallen to 17%;® in 1946-47 it was probably 
up to 20%. 

9. Rationing 

Confirmation of the improved availability of foodstuffs in 1946, 
especially after the good harvest of that year, came with the increase 

« G. Tagliacame, Le vis di rifornimento delVItalia (The Supply Roads of Italy), 
Confederazione dei Commercianti, Roma, 1940. 

• TJNRRA, Italian Mission, Survey of Ittdy'e Economy ^ 1940. 
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in rations obtainable by ration card. From a total of 747 calories per 
day per normal consumer in the first quarter of 1946, ration availabilities 
climbed to 958 in the last quarter of that year. That this increase was 
not of an entirely seasonal nature is shown by the fact that in the first 
months of 1947 there was a substantial increase over the preceding year. 
The rations distributed by ration card during the first five months of the 
current year had to be reduced because of the shortage of wheat supplied, 
but despite this they furnished 851 calories per day as against 729 for 
the corresponding period of 1946.'^ 

The average daily ration distributed by ration card in 1946 contained 
a total of 839 calories, about one-third of the normal consumption on the 
basis of prewar averages. The ration for the first five months of 1947, 
consisting of 851 calories, satisfied no more than 40% of the total reduced 
food consumption. The other 60% of food needs were being met by 
products bought on the free market (nonrationed products) or on the 
black market (rationed products). 

Bread, a fundamental element in the Italian diet, supplies 73% of the 
total caloric value assured through the ration card. And yet the bread 
ration is only 235 grams daily per capita, which is the lowest of any 
country in Europe. Several months ago this ration was further reduced 
to 200 grams, the other 35 grams being replaced with distributions of 
maize flour. 

Products used for making soup (pasta, rice, legumes, flour) contribute 
17% of the caloric value distributed by ration card; fats represent only 
^%» sugar 4%, and meat is insignificant (average 1946). 

Tabt.e 5 

Average Daily Caloric Value of Rations Distributed in 8 Cities, For Normal Consumer 

Soup products, Fats, meat. 

Bread legumes milk products Sugar Total 

Average of first 5 months, 1946 563 98 47 21 729 

Average of first 5 months, 1947 571 186 54 40 851 

Source: Data from the Central Institute of Statistics. Onr calculation for the averape of eight 
cities. 

10. Meat Consumption 

Statistics of taxes on meat sales and on animal slaughter give us an 
idea of the changes that took place in the consumption of meat in 1946 
as compared to the prewar period. According to our calculations using 
the data of the above-mentioned sources, meat consumption decreased 

’ These figures are an average for 8 principal cities. They include only rations 
distributed to “normal” adults and exclude the supplementary rations given to 
children, old people, and laborers doing heavy work. 
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from 31.10 kilos per capita in 1938 to 22.78 in 1946, a drop of 27%. The 
most important decreases were in the consumption of veal and pork, 
the most expensive types of meats, while there has instead been a strong 
increase in the consumption of horse meat. The lowering of quality 
level shows up clearly in the following table in the comparison of the 
percentages: 


Tabt.e (» 


Composition of Meat Consumption 



1938 


1946 



Kilos 

% of 

Kilos 

%of 


per capita 

total 

per capita 

total 

Veal 

10.42 

33.51 

6.48 

28.46 

Other beef 

12.56 

40.38 

9.36 

41.09 

Pork 

6.66 

17.88 

3.30 

14.19 

Poultry- 

2.18 

7.01 

2.04 

8.95 

Horse 

0.38 

1.22^ 

1.60 

7.02 


31.10 

100.00 

22.78 

100.00 


Note: These figures are based on sales taxes on meat; figures for 1946 arc for the first half year 
multiplied by two. 


11. Tobacco Consumption 

The reduction in the consumption of cereals, meats, and food in ge¬ 
neral has been imposed by the shortage of these products; it will be inter¬ 
esting to examine now the trend in the consumption of other products 
and luxury expenditures. 

An important index is tobacco. Per capita consumption decreased 
from 653 grams in 1938 to 547 grams in 1946, but it is now increasing 
appreciably month by month, and during the first three months of 1947 
it had surpassed the prewar level. In fact during these first three 
months it was 673 grams per capita as compared to 494 grams during 
the corresponding period of 1938. 

These statistics are the official ones. It must be pointed out that, 
as everyone knows, besides the national tobacco, which is controlled 
by a State monopoly and rationed, there is a flourishing black market 
in foreign tabacco. Although there is no way of calculating the amount 
thus sold, it is certain that it is sufficient to bring today’s per capita 
tobacco consumption to a level at least 50% higher than before the war. 

12. Expenses f6r Amusement 

An analogous trend has been taking place in expenditures for theaters, 
movies, and gambling. The latter has reached such large proportions 
in the postwar period as to surpass the combined total spent on the 
theaters and sport events. But the largest share of the expenses for 
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amusement still goes to the movies, which in 1946 absorbed three-fourths 
of the total spent by the Italian population on entertainment as com¬ 
pared to 71% in 1938. For this type of entertainment the population 
of Rome in 1946 spent an average of 1,150 lire per capita to see 21 pic¬ 
tures. For all of Italy it has been calculated that each Italian in 1946 
went to the movies or the theater about 12 times as compared to 10 
times in 1938. 

The figures for the first months of 1947, though not yet definitely 
known, indicate a continuous increase not only in expenditures, which 
is largely due to the increase in the prices of tickets, but also in the number 
of performances attended. 


13. The Displacement of the Middle Classes 

Although an increase in certain luxury expenditures is shown in the 
two preceding chapters, one must not get the impression that this demons¬ 
trates an improvement in the general level of living. This type of 
increase in expenses is explained rather by changes in the relative posi¬ 
tions of the various social classes of the population and by changes in 
customs and habits. 

Every war, with the inflation and social upheavals that follow in its 
wake, creates classes which are particularly favored by the events. In 
general these classes are composed of enterprisers, and in particular of 
persons who deal in military supplies and in items which are especially 
in demand, such as food, durable goods, etc. At the top of this large 
group of persons favored by the events of the war and the postwar in¬ 
flation, one finds numerous profiteers and speculators. These are the 
groups that help increase the consumption of luxuries. Other social 
groups which have been unaffected or affected only slightly by the drop 
in real incomes (farmers and certain classes of workmen) also contribute 
to this increase. 

In contrast to this, the vast middle classes^ which in Italy are estimated 
at 10 million persons (20% of the population) suffered much from the 
drop in their incomes, which remained far below' the increase in prices 
and cost of living. 

Special surveys® on the condition of these classes in the postwar period 
indicated the great sacrifices undergone to hold on the way of life which 
even under adverse conditions distinguishes them from the other strata 
of the population. They fell back on accumulated savings and sold 
objects of art, jewels, furniture; they pared all superfluous expenditures 
from their budget and lowered ther standards of consumption; finally 

P See, for example, the survey presented by Prof. Ugo Giusti at the meeting 
held in April 1947 by the Italian Society for Demography apd Statistics. 
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they were forced to send the ‘‘idle” members of the family out to look 
for gainful occupations. 

It is our conviction, as we mentioned before, that this phenomenon 
we have surveyed is a passing one, the result of a rapid inflation and 
of the sharp cut in the national income, a phenomenon therefore neces¬ 
sary under the present exigencies but destined to return to the normal 
differentiations of the prewar period as soon as the lira is stabilized, 
industrial development resumes its course, and national wealth increases. 


R^sunri^ 

Le coflt de la vie en Italic est considerablement accru apres la guerre, 
notamment depuis la fin de 1945. En comparaison avec Taugmenta- 
tion des prix aprfes la premifere guerre mondiale, nous pouvons affirmer 
que dans ce deuxifeme aprfes-guerre le cout de la vie a augmente k peu 
prfes dix fois plus (en juillet 1947, 50 fois les prix de 1938) qu'il avait 
augments aprfes la premifere guerre (4 la fin de 1920, 6 fois les prix de 1914). 
Les salaires, et notamment les appointcments des employes, n’ont pas 
augraent6s dans la meme proportion. Les ouvriers non qualifies 
ont vu leur salaife s’accroitre au moins 40 fois, c’est-4-dire le salaire 
r6el s’est reduit de 20 pour cent environ. Mais les appointements des 
fonctionnaires plus eleves ont vu leur salaire reel se restreindre de 60 
pour cent (et quelquefois plus) de ce qu’il etait avant la guerre. 

Cette tendance a Tegalisation des retributions acquises aux d6penses 
des employes a produit un veritable declassement des classes moyennes. 
Les individus de ces classes de la societe ont du se sacrifier, c’est-^-dire 
reduire les depenses de Talimentation aussi bien que celles des vetements 
et de rinstruction, et enfin ils ont dti avoir recours dans une large mesure 
aux 6pargnes accumulees dans le passe. Les femmes et les enfants ont 
dh chercher un emploi pour compenser Tinsuffisance du salaire du 
chef de famille. Les consequences ne sont pas n^gligeables. II y a une 
reduction du montant de nouvelles ^pargnes parce que les nouveaux 
riches n’ont pas acquis I’habitude et Tesprit pour s’imposer de tels sacri¬ 
fices; les employ 6s ne sont pas encourages k 6tudier, k perfectionner leur 
preparation, puisque leurs fatigues et leurs sacrifices ne sont pas suffisam- 
ment recompenses. D’autre part, le sentiment de la hierarchie est 
serieusement atteint. 

II se pent que cette situation du nivellement des salaires soit une 
necessite du temps present, tTfes penible pour tous; mais s’il n*en etait 
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pas ainsi, nous devrions nous attendre k un abaissement dangereux du 
niveau intellectuel g6n6ral, de Tesprit d’6pargneet enfin une reduction 
relative des classes moyennes, tr^^s redoutable, car elles sont des elements 
d*6quilibre, de stability et 'de paix dans la societe nationale, 


Discussion 

Mr. Agapitides added a few words concerning the situation of 
salaried people in Greece. Indices which he has prepared shoAV that 
during the war, e,g., real salaries of public officials decreased by April 
1944 to 7% of their prewar level. 

Mr. Agapitides described the effect of stabilization of the national 
currency after liberation, when real salaries first increased to 70% of 
prewar and then dropped again with a new inflation of the national cur¬ 
rency. Repeated attempts at stabilization have only been followed by 
infiation. 
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LES PROGRES REGENTS DE LTTUDE DES 
OPINIONS EN EUROPE 

par Jean Stoetzel 

Le beau travail qui vous a 6te presente samedi dernier par le professeur 
Frederick F. Stephan sur “rhistoire de Tutilisation des proc6d6s mo- 
dernes d’echantillonage”, pourrait servir de modMe 4 une histoire des 
enquetes d’opinion. Les curieux n’ont certainement pas fini de trouver 
des ancetres de plus en plus recules aux enquetes de Gallup et de Fortune, 
Emil Hurja a cite deux enquetes americaines pr^coces, realisees en 
1824. Mais le comte de Lavalette en France, quelque vingt cinq ans 
plus t6t, et Daniel Defoe, en Angleterre, plus d’un siecle auparavant, 
avaient d6ja mis sur pied des organisations pour le sondage des opinions. 

Cependant, en depit de. Tattrait de Tanecdote et des satisfactions que 
peut procurer la prehistoire, il reste legitime d’affirmer que Tetude pro- 
prement scientifique des opinions dans le monde n’a pas une histoire 
de plus de vingt cinq ou trente ans. Si Ton se borne k ce qui est vraiement 
Tessentiel, il faut faire remonter k la decade 1920-1930 le premier ensemble 
convergent de recherches sur les opinions. L’apparition des premiers 
sondages de Vopinion publique ne d^passe gufere 1935. Encore faut-il 
ajouter que les premieres realisations sont toutes americaines. J’aurai 
done k vous parler ici du plus recent parmi le recent. 

En 1939, la veille de la guerre, I’Europe n*avait encore gufere mani- 
feste d’interet pratique pour Tetude des opinions. Si Ton met k part 
les recherches du professeur Andre Siegfried, basees sur Tanalyse des 
yesult^ts des elections fran 9 aises dans diff6rentes provinces, recherches 
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remarquable par la precision de la m6thode et par la finesse des hypotheses 
qui les sous-tendaient, mais cependant recherches d’archives, recherches 
passives par consequent, et de plus extremement limitees dans le champ 
des opinions, on ne trouve gufere de preoccupation de ce genre dans les 
milieux universitaires. Deux organisations de sondages seulement 
existent, et de fraiche date, une en Grande-Bretagne, et une en France. 

En 1947, nous rencontrons au moins quinze organisations de sondages 
en Europe, distribuees dans douze pays, savoir: Allemagne (deux orga¬ 
nisations, au moins); Belgique, Danemark, Finlande, France (deux orga¬ 
nisations), Grande-Bretagne, Hongrie, Italie, Norv^ge, Pays-Bas (deux 
organisations), Sufede, Tchecoslovaquie. Encore faut-il ajouter qu’il 
existe une deuxi^me organisation en Norvfege, et une troisieme en Alle¬ 
magne, sur lesquelles je n’ai pu recueillir de documents precis; et qu’il 
y a aussi un second institut cn Belgique, et un en Suisse, ces deux derniers 
cependant ne paraissent pas avoir depasse la periode experimentale. Je 
devrai m’abstenir de parler de ces quatre organisations, qui porteraient 
k dix-neuf le nombre pour TEurope. 

Ainsi, I’etude europeenne des opinions est toute recente: ceux ins- 
tituts fonctiennaient avant 1940; deux apparaissent entre 1940 et 1944; 
et onze se d6veloppent depuis 1944. II est juste d’ajouter que parmi 
ces onze instituts, deux au moins avaient deja jete leurs premieres bases 
avant 1944. La creation et le fonctionnement des instituts d’opinion 
en Europe n’ont pas manque, au moins au debut, d’etre accueillis avec 
indifference, scepticisme, voire meme d’etre I’objet de vives critiques. 
II est assez remarquable que ce sont surtout des economistes et des per- 
sonnes appartenant au milieu des affaires, qui ont pris surtout I’initia- 
tive de creer de telles organisations. C’est ce qui s’est passe dans huit 
cas sur quinze. Les sept autres instituts ont ete fondes respectivement 
par: deux statisticiens, deux psychologues, un sociologue, un militaire, 
et un ancien consul. 

II semble que Ton assiste actuellement en Europe a une acceptation 
de plus facile de la nouvelle branche de recherche. L’age du directeur 
k la date de la creation de chaque nouvelle organisation a tendance k 
s’61ever; ses autres fonctions, anterieures ou simultanees, evoluent dans 
un sens bien defini; la forme meme des organisations change. Pour 
la periode anterieure k 1940, les hommes qui ont cree les deux premi&res 
organisations de sondages sont ages en moyenne de 30 ans a la date de 
la fondation; entre 1940 et 1944, les nouveaux dirigeants ont 35 ans en 
moyenne; depuis 1944, I’&ge moyen des directeurs des onze plus recents 
instituts sera, toujours aux dates respectives do leur fondation, de 40 
ans environ. De meme, tandis qu’avant 1944, on trouve seulement 
un universitair© parmi les quatre directeurs, depuis 1944, les onze nou¬ 
veaux instituts ont k leurs t«te cinq universitaires et trois autres fonc- 
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t ohnaires, plus de la moiti^ par consequent. Enfin, toutes les organ!* 
sations anterieures a 1944 sont commercialese alors que, parmi les ouzo 
nouveHes, cinq seulement sont dans ce cas; les autres sont, soit des fon* 
dations privees non commerciales, soit des institutions publiques ou 
semi publiques. 

L’activite des organismes europeens de sondages est trfes honorable, 
comparativement It celle des meilleures organisations americaines, qui 
sont leurs ainees souvent. Deux organisations seulement font moins 
de six enquetes d’opinion par an. Six en font un nombre compris 
entre 6 et 10, trois en font de 10 k 20, et quatre en font plus de 20 annuel* 
lement. Ceci naturellement n’inclut pas les enquetes commerciales, 
ou les etudes sp6cialement commandees par des organismes ou des per- 
sonnes interessees, et qui ne donneront pas matifere k publication. 

Dans la plupart des'cas, les r^sultats des enquetes sont communiques 
It la presse. Quatre institute au moins disposent de contrats de presse. 
Mais, en outre, neuf instituts cmt leurs organes propres. Deux publient 
plus de douze bulletins par an; deux ont une publication mensuelle; les 
cinq derniers publient moins frequemment. 

Le nombre des sujets interroges au cours d’une enquete varie, suivant 
les instituts et suivant les enquetes, entre 1.500 et 5.000, avec une moy- 
enne d’environ 2.500. Presque tous les instituts utilisent la m^thode 
de Techantillonnage stratifi6, sauf un, qui utilise Techantillonnage au 
hasard. Tous les instituts qui pratiquent Techantillonnage stratifi6 
choisissent toujours leurs sujets en tenant compte du sexe, de TUge, de 
Thabitat et de la region. Mais on peut observer une tendance, parmi 
les instituts les plus recents, k s’ecarter du principe de choix par niveau 
de fortune, toujours assez incertain, et peut-^tre de moins en moins sig. 
nificatif en Europe, et k le remplacer par un choix par professions. C'est 
actuellement le cas d’au moins six instituts sur treize (14 pratiquent 
r6chantillonnage stratifie; les renseignements manquent k cet egard 
sur Tinstitut hongrois). 

Ajoutons enfin que Tequipement materiel et en techniciens des orga¬ 
nismes europeens de sondage est en general bon ou trfes bon. Presque 
tous font usage des facilites du depouillement m6canographique. Deux 
instituts disposent de moins de 100 enqueteurs. Trois en ont de 100 
k 200, quatre de 200 k 300, et six en ont 300 ou plus. 

On peut done dire que TEurope commence a disposer, depuis la fin 
de la guerre, d’un ensemble de stations pour T^tude de Topinion, et que 
cet ensemble presente une bonne valeur technique, sufl&samment homo- 
g^ne d6jli. J’ai intentionnellement omis de mentionner les travaux 
d’une organisation britannique privee dejii encienne, qui ne fait pas 
k proprement parler des sondages, mais dont les enquetes qualitatives 
d’opinion sont fort interessantes; je n’ai pas parl6 non plus de la section 
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de Bondages qui existe au sein de Tlnstitut National de la Statistique 
et des Etudes 6conomiques, du gouvernement fran 9 ais. Cette der- 
niere organisation, qui 6vite d’aborder les questions subjectives, ne ren- 
tre done pas dans le cadre de cet expose; elle ne manquera pas d’appor- 
ter cependant, sur le plan technique, sa contribution k de nombreux 
problemes que pose quotidiennement la pratique des Bondages. . 

D’ores et dej4, le fonctionnement et les recherches particuli^.res des 
instituts europeens d’opinion ont amene ou promettent d'amener k breve 
echeance des progres de methode interessants. Ces progres sont d’ordre 
tres divers et d’importance tr^s variable. Certains peuvent paraitre 
negligeables et servir cependant de point de depart a des d^veloppements 
considerables. D’autres sont peut-etre destines a amener des decep¬ 
tions. Je ne pretends pas a Tinfaillibilite dans le choix que je vous en 
pr68enterai ici. D’un autre cote, je ne me flatte pas davantage de ne 
pas commettre d’erreurs ni d’omissions, et je m’excuse a Tavance pour 
cette possibilite aupr^s de tous mes collogues presents et absents. J’in- 
sisterai trop probablement sur les travaux fran 9 ais; ce sont^ par la force 
des choses, ceux que je connais le mieux. 

Au credit de I’lnstitut britannique d’opinion publique, nous devons 
certainement porter d’ingenieux perfectionnements pratiques, notam- 
ment dans la rationalisation de la correspondance avec les enqueteurs 
et de la technique mecanographique. L’Institut britannique, doyen 
des instituts europeens, poss^de une experience consommee dans la 
pratique des Bondages, et a acquis, dans les domaines oil il op^re, la mai- 
trise presque absolue de son instrument. II a servi de modMe a de nom¬ 
breux instituts nouveaux, notamment les instituts nordiques. Parmi 
plusieurs autres recherches, Tlnstitut neerlandais se signale it notre 
attention particuliere par I’etude qu’il poursuit depuis un certain temps, 
des facteurs psycho-morphologiques des opinions. II appartenait aux 
compatriotes de Heymans et de Wiersma de penser k chercher dans la 
caracteriologie individuelle la source de la relative incertitude k pre- 
voir les opinions d’un individu socialement determine. S’il en est bi'en 
ainsi, les recoupements traditionnels, tous de nature sociologique, de 
I’echantillonnage stratifie, devront k I’avenir s’accompagner de consig- 
nes aux enqueteurs, relatives au choix des sujets d’apres leurs appa- 
rences physiques. Ce sont la des perspectives pleines de promesses. 

Le jeune organisme de sondages de Milan, Doxa, est particuli^rement 
actif en ce moment sur les problemes pratiques de I’echantillonnage. 
II a con 9 U d’une part une methode d’echantillonnage stratifie qui serait 
fonde sur la localisation des differentes classes d’individus selon les heu- 
res de la journee. D’autre part, il m^ne des experiences de tirage au 
sort pour echantillonnages topographiques, k comparer aux r^sultats 
de Fechantillonnage stratifie. Peut-etre contribuera-t-il k apporter. 
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du o6te experimental, quelque lumi^re k I’irritante querelle des parti¬ 
sans de Tune et de Tautre methodes. 

L’Institut Frangais s’est lance, lui aussi, k Tattaque de plusieurs pro- 
biemes pratiques. Je me limiterai k quatre questions, deux psycholo- 
giques, et deux statistiques. En premier lieu, il etudie depuis plus d’un 
an une methode de tests psychologiques pour la selection des enque- 
teurs; en second lieu, il a congu, et finit de mettre au point, une methode 
d’apprentissage des enqueteurs par disques de phonographe. Du cote 
de la pratique statistique, I’lnstitut Frangais a realise une table de pour- 
centages commode qui accelfere considerablement les caleuls arithme- 
tiques dans de nombreux cas; et il a realise des abaques qui rendent 
trfes rapide le calcul de 2 comme test de signification des differences et 
des associations. Il a Tetude un appareil qui sera destine k montror 
imm6diatement le caract^re significatif ou non significatif des differences 
et des associations. 

Parmi les developpments recents de I’etude des opinions en Europe, 
je ne dois pas manquer de signaler, en terminant, les efforts pers^ve- 
rants des instituts europ^ens pour coordonner leurs recherches et Tetude 
internationale des opinions. Les accords bi-lateraux nombreux con- 
clus anterieurement a 1947, se sont integr^s au congres de Paris, en 
janvier 1947, par la creation d’une commission europeenne de Topinion 
publique, qui groupe les instituts de FEurope occidentale. Le congri^s 
de Loxwood (Angleterre), en mai 1947, a de plus about! k la creation 
d’une association internationale des instituts d’opinion publique, qui 
lie huit instituts d’Europe k quatre instituts des Ameriques et d’Aus- 
tralie. Puisse FAssociation internationale des recherches sur Fopinion 
publique, preparee au debut de ce mois de septembre 1947 au congres 
de Williamstown, reseerrer encore les liens de travail qui uni^sent dkjk 
tant de chercheurs et d’institutions en Europe et dans le monde, non 
seulement pour le bien de la science psycho-sociale, mais encore pour 
ce qui est le but le plus important de tous nos efforts, une comprehen¬ 
sion reciproque enfin adequate des difficultes et des aspirations des peu- 
ples par leurs dirigeants et par eux-memes. 


Resume 

The study of opinions has not a very long history. One has only 
to go back to the decade from 1920-1930 to the first experiments which 
took place, both in the universities and in the field of market studies. 
The appearance of the first scientific investigation of public opinion 
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does not go back much before 1935. All of these attempts first appeared 
in the United States. On the other hand, if we confine ourselves to 
the year 1947 and if we prepare a geographic map showing the countries 
which are making studies of public opinions, we see that the maximum 
density of research is in Europe. There has been recently, therefore, 
a considerable growth in the study of opinions in Europe. 

There exist 15 opinion institutes in Europe, 11 of which have been 
founded since 1944. These 15 institutes are located in twelve countries: 
Germany (2), Belgium, Denmark, Finland, France (2), Great Britain, 
Hungary, Italy, Norway, The Netherlands (2), Sweden, and Czechoslo¬ 
vakia. A second institute exists in Norway but the date of its founding 
is not known and it is not included here. It appears that there is also a 
second institute in Belgium and one in Switzerland; but these two ap¬ 
parently have not developed beyond the experimental stage. 

Nine institutes are commercial or privately-owned organizations, 4 
publicly administered organizations and 2 non-profit organizations. The 
training of the director is as follows: economics 5, business and public 
relations 3, statistics 2, psychology 2, sociology I, other 2. 


The activities may be shown by the following figures: 


Number of Surveys Per Year 

Number of Institutions 

Less than 6 

2 

From 6 to 10 

6 

From 10 to 20 

3 

More than 20 ^ 

4 

Publications 

More frequently than monthly 

2 

Monthly 

2 

Less frequently than monthly 

5 

Without own publication 

5 

Number of Interviewe/vs 

- 

Less than 100 

2 

From 100 to 199 

3 

From 200 to 299 

4 

300 and over 

6 


A ll of the institutes use the quota method of sampling, with the ex- 
,ception of one which uses area sampling. Stratification is always made 
iby sex, age, type of dwelling, and geographic region. Moreover, seven 
institutes use as a principle of sampling the level of income; five, 
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occupational status; one institute uses both criteria. Data are lacking 
on one institute. 

Allowing for errors and omissions resulting from the lack of complete 
knowledge by the author, the principal progress realized from the re¬ 
search undertaken in the field of opinion studies by the European insti¬ 
tutes to date in 1947 is as follows: 

British Institute of Public Opinion (BIPO): correspondence with 
the interviewers; mechanical sorting. 

Netherlands Institute of Public Opinion: morpho-psychological fac- 
tors of the opinions. 

Italian Institute of Public Opinion (DOXA): recent developments 
in stratified sampling; experiments in area sampling. 

French Institute of Public Opinion (IFOP); research on the preli 
minary selection of interviewers by psychological tests; training of inter¬ 
viewers by phonographic records; practical problems of statistics: sim¬ 
plified table of percentages, abacuses to speed up the calculation of chi- 
square, study of an apparatus designed to show immediately the signi¬ 
ficance of differences and of associations. 

Finally, it is important to note the persevering efforts of the European 
institutes to coordinate their theoretical research and the international 
study of opinions. The numerous bi-lateral agreements concluded prior 
to 1947 were integrated at the Paris Congress in January 1947, by the 
creation of a European commission of public opinion which groups all 
of the institutes of continental Europe. The Loxwood Congress (Eng¬ 
land) in May 1947, resulted in the creation of an international associa¬ 
tion of institutes of public opinion which unites eight institutes of Europe 
with four institutes of the Americas and of Australia. 



PUBLIC OPINION RESEARCH IN LATIN 
AMERICA 


by William Herrington {United Stated), President 
and 

Alberto Castelli (Argentina), Vice President 
International Public Opinion Research, Inc. 

PiiESENT Status op Public Opinion Research in Latin America 

Public Opinion research in Latin America is in a very initial stage, but 
this new science is advancing there more rapidly than in many other 
areas of the world. Tn recent years polling organizations have been 
established in Brazil, Cuba, Mexico, Argentina, and opinion polls 
have been conducted in these countries and in Colombia and Venezuela. 
The work of most of these organizations has been of a preliminary or 
experimental nature, and has met with varying degrees of success. In 
most cases the polls have been restricted to segments of the population 
in the principal cities or in the higher socio-economic classes. Practical 
difficulties have prevented the taking of polls representative of the 
entire population of any country. For example, rural population has 
seldom been included, and the Jower economic classes have not 
generally obtained proper representation. 

Factors Favoring the Development of Public Opinion Research 
TN Latin America 

Several factors are at present working in favor of the development 
of public opinion research in Latin America. A growing interest in 
opinion research, and in the findings of opinion polls, has been shown 
in educational, business, and publishing circles. 

In the universities, professors and students of statistics, economics, 
sociology, psychology, and related subjects are eager to be made aware 
of each new step in the growth of this as yet infant offspring of more 
mature sciences. 

Alert businessmen including some who have heretofore made little 
use of statistics, have indicated a desire to be informed about the appli¬ 
cation of public opinion research to business problems. Business leaders 
are particularly interested in the use of public opinion research in public 
relations, where the attitude of the public toward an industry, a company, 
or its products, its distributors and services, may have a serious bearing 
on the ultimate, if not the immediate, success of an enterprise. 

Editors and publishers, who are familiar with the .interest of readers 
in where the r^ults of opinion poljs are published regtilarly 
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as syndicated features in newspapers and magazines, are anxious to have 
such polls established in their own countries in order that they may 
use them as a means of increasing circulation. Some newspaper pub¬ 
lishers in Latin America have attempted, within the limited knowledge 
and means at their disposal, to conduct public opinion research, but in 
general the results have not been very satisfactory when judged by strict 
standards of reliability and significance. 

In addition to growing interest among influential groups, another 
factor working in favor of the development of facilities for public opinion 
polls is the demand of North-American and European business firms 
for better facilities for market research in Latin America. The fact 
should be mentioned that in the United States, Canada, England, France, 
India, Australia, and other countries where public opinion polls are now 
regularly made, this development followed the establishment of facilities 
for market surveys in behalf of business interests. As is well known, 
in the United States market surveys were conducted for more than a 
score of years before public opinion polling began in 1935. The concept 
“markets are people”*which required the development of means of finding 
out what people want, led naturally into the development of means 
of finding out what people think. 

For many years business interests have been in need of more informa¬ 
tion about the consumer and industrial markets of Latin America. This 
need probably has beep felt more outside of Latin America, by compa¬ 
nies accustomed to having such information supplied to them by market 
research within their own countries, than within Latin America, where 
market surveys, until recently, have not been common. 

This demand for more market information, derived from consumers 
and distributors themselves, has led numerous North-American and 
European companies to sponsor surveys and to employ and train the ne¬ 
cessary national personnel for accomplishing them, at least in the most 
potential marketing areas. Such efforts serve to develop an apprecia¬ 
tion among Latin-American business leaders of the important part which 
reliable market facts now play in the operations of most successful busi¬ 
ness enterprises. They serve also to prepare the way unintentionally 
but nonetheless definitely for public opinion research. 

A third factor working in favor of the development of opinion research 
in Latin America is, of course, the present trend toward international 
opinion polls in which many areas of the world are to be represented. 

This trend was discussed and furthered at the very recent Second In¬ 
ternational Conference on Public Opinion* Research, meeting at Williams 
College in Massachusetts. At this conference a preliminary organiza¬ 
tion was set up to make preparations for a World Congress for Public 
Opinion Research to be convened in 1948., Thirteen nations were repre- 
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sentcid at the recent meeting, and many more are expected to be repre¬ 
sented at the projected meeting next year. Elected president of the 
preliminary organization at this year’s gathering was Jean Stoetzel, 
head gf the French Institute of Public Opinion. Mr. Stoetzel is a recog¬ 
nized authority among opinion research experts, and the one who is best 
acquainted with the present status of the new science as applied in Eu¬ 
rope. Among the vice presidents who will assist him in preparatory 
plans are: Dr. Laszlo R a d v a n y i, Professor at the National Uni¬ 
versity of Mexico; Theodore Lentz, Professor at Washington Univer¬ 
sity, St. Louis; David Glass and Mark A b r a m s of England; and 
Dr. Julian Woodward of the Elmo Roper organization, New York. 
Many others representing additional countries will participate in the 
work of preliminary committees yet to be formed. 

This development of international polls is now largely the concern 
of individuals engaged in public opinion research, and it will continue for 
many years to be chiefly their concern, because of the extremely difficult 
if nob insuperable problems which are encountered in any attempt to 
gather a concensus of public opinion on any question on a world-wide 
scale. Ho wever, the development of international polls arises also in res¬ 
ponse to a genuine need for them. Their use by agencies of the United 
Nations may bo a somewhat distant possibility, especially in view of the 
fact that such polls are not now among the instrumentalities of national 
governments, but such use can be conceived of as a desirable possibility. 
Some preliminary trials have been made already by the Gallup affiliates 
in attempting to c 3nvey the same questions to people of several nationa¬ 
lities, and experimental work in this direction will be accelerated by the 
world organization for opinion research. W^hen the time for interna¬ 
tional polls of public opinion arrives, the reliably recorded opinions of 
Latin-American peoples will be necessary among the opinion of other 
peoples of the world. This trend toward world opinion polls is an encour¬ 
agement to the growth of public opinion research in Latin America 
today. 

Factors Delaying Opinion Research Development 
IN Latin America 

Those of us especially who are engaged in the statistical and social 
sciences may think it worth while to consider, on the other hand, some 
of the factors which appear to be delaying the development of this mo¬ 
dern science of opinion polling in Latin America. 

Perhaps no attempt should be made to mention these delaying fac¬ 
tors in any order of importance; however, the need for more teachers 
and students of the technical aspects of public opinion polling does ap¬ 
pear to be among the primary blocks to progress. This need for experts 
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I d students acquainted with the principles, current practices, and re- 
iViaining problems of this science is by no means limited to Latin America; 
it is world-widcf. A significant peculiarity of this need in Latin America 
is the fact that the majority of the problems in practice have to be re¬ 
solved at the local level within the countries in which the polls are made. 
These problems must be solved by individuals who are not only well- 
grounded in the science of opinion research but who are, also, most 
familiar with the available national and local means of solving them. 

Fundamental in the knowledge of such experts in Latin American 
countries must be a thorough understanding of sampling theory and prac¬ 
tice, questionnaire design and pre-testing, interviewer training and su¬ 
pervision, advanced coding and tabulating processes, significant means 
of analysis and reporting. Provision must be made in questionnaires 
and analyses for showing the effects of knowledge or lack of knowledge 
on opinion, the reasons for opinions, and the degree of convictions with 
which they are held. 

Unfortunately, in the short period of its existence, public opinion re¬ 
search has become a very complicated science without adequate text¬ 
books from which it can be learned. Many helpful studies have been 
published, especially in technical journals, but every conference of pol¬ 
ling experts yields additional evidence of the fact that teachers and prac¬ 
titioners of the new science must indeed exercise great intellectual cu¬ 
riosity and considerable initiative if they are to keep themselves well- 
informed concerning the latest additions to the knowledge of and the 
most accepted practices in opinion research. Mr. George Gallup, 
a widely recognized authority in this subject, has stated that the chief 
factor delaying opinion research everywhere is the lack of qualified per¬ 
sonnel, and this is true for America as well as for Europe and Asia. 

The factor next in importance as a cause of delay in the development 
of public opinion research in Latin America is the lack of statistical data 
suitable for use in sampling, both on the national and the community or 
local levels. • 

As this group well knows, population and business census activities 
in many Latin-American countries have been handicapped in the past 
by a variety of irregularities with respect to timing, standards, scope, 
supervision, analysis, and publication, and particularly in the availabi¬ 
lity of funds. Such handicaps are by no means confined to Latin Ame¬ 
rica—they plague the work of statisticians in all parts of the world and 
constitute a bond of sympathy. In our insatiable desire for facts and 
figures our profession is misunderstood, especially by politicians. 

Public opinion research needs and makes effective use of the best 
existing census-type data. It calls for special organization of such data 
as well as for new kinds. In Latin America, as everywhere, the greatest 
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need is for data which serve as criteria for determining the social and/or 
economic well-being of the population. Individual or family income 
statistics and home rental or valuation statistics may be mentioned as 
examples, but other criteria peculiarly indicative of socio-economic 
strata of population in Latin-American communities are needed as much 
or more. Eor example, data with regard to the kinds of bread eaten, 
the kinds of beds slept on, the kinds of roofs or floors of dwellings and the 
public services or conveniences used have been shown to be valuable 
tools to the sampling technician, particularly when these data are avail¬ 
able at the community level. In the application of the newly devised 
area-sampling techniques, more community maps and listings of popu¬ 
lation are especially needed. 

All opinion research workers in Latin America should work for the 
successful culmination of the plans for a simultaneous and standardized 
census of all Latin American peoples in 1950, the child of great promise 
long nurtured by the Inter American Statistical Institute. 

A third factor which is likely to delay the development of public opi¬ 
nion research in Latin America is the tendency to regard this new branch 
of statistical activity as primarily a tool of business rather than as an 
aid to the social sciences. Social scientists and statisticians of all kinds 
in Latin America should recognize the place of public opinion polls in 
their work; should welcome this means of furthering their studies and 
attaining their objectives. If opinion research is left dependent for its 
support on business and commercial interests in Latin America, there 
will be a considerable delay. Those interested in this development 
should seek the support of public and private institutions. Such sup¬ 
port will enable carefully designed experiments to be carried on and will 
bring Latin America to the forefront among the present users of this 
means of measurement. 


Future of Pusiiio Opinion Research in Latin America 

What, then, may be said of the future of public opinion research in 
Latin America? In considering this prospect, the authors of this brief 
discourse would like first to pay a tribute, and second to offer a warning. 

Among the statistical and social scientists of Latin America today 
there is a great eagerness to learn more about and to make more effective 
use of public opinion research. The importance of this development is 
realized by many teachers and students in the universities and by direc¬ 
tors and officials of government or private agencies. 

Requests are constantly being received for more books and literature 
on the subject, and such material is being widely circulated and tho¬ 
roughly studied. Many Latin American authorities and students have 

67 



530 INTBBiTATIONAL STATISTICAL OONPEBBNCBS: I S I 

used the more direct means of learning by personal association with those 
who are teaching or engaging in opinion research. The teaching of samp¬ 
ling methods has begun in the universities, and technical treatises by Latin 
American authors are appearing in statistical and social science journals. 

These are indeed encouraging signs, and the delegates of Latin Ame¬ 
rica to this conference are to be congratulated on the alacrity with which 
they and their colleagues have laid hold of this new opportunity to ad¬ 
vance the profession through the use of statistical science in public opi¬ 
nion research. 

The advice of caution springs from several sad chapters in the experi¬ 
ence of opinion researchers in the United States and other countries 
where polling has become an accepted practice. Public opinion research 
wherever it is practiced by authorities today is an exacting science. In 
all of its five or six methodological divisions the complexity is increasing 
rather than diminishing. It is true that public opinion polls in some 
countries have attained a high degree of reliability, but it is also true 
that the precise practices which have proved reliable in one country can¬ 
not be merely transferred to another. 

Continuing on the warning note, the false starts and blunders which 
have accompanied the development of public opinion polls elsewhere 
can be avoided in Latin America if workers in this science will undertake 
the experimental work necessary to determine how the principles and 
most advanced practices can be interpreted for use under widely various 
conditions. 

Those who engage in public opinion polling in Latin America, also, 
like professional opinion researchers everywhere, must guard against 
fly-hy-night opinion research organizations and charlatons of every 
stripe, using unsound methods for selfish or even dishonorable purposes 
without regard for the reputations of those who endeavor to serve the 
common good and to maintain the highest standards. To prevent such 
retarding and damaging influences, the continuation of widespread edu¬ 
cational efforts—both public and professional—is vital; and a special 
training program in opinion research, under the guidance of the Inter 
American Statistical Institute is greatly to be desired. 


Resum^ 

Le sondage de Topinion publique en Amerique latine se trouve encore 
dans la phase initiale, mais fait de plus rapides progrfes que dans plusieurs 
autres parties du monde. 
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Plusieurs facteurs exercent k present leur influence en faveur du deve- 
loppement du sondage de I’opinion publique en Amerique latine. 
Parmi les facteurs les plus influents il faut mentionner un interet crois- 
sant dans le sondage de I’opinion publique et dans les resultats des son- 
dages, manifesto par les milieux de Tenseignement, des affaires et de la 
presse ainsi que des demandes ton jours plus nombreuscs, de la part 
de firmes coramerciales de TAmerique du Nord et do TEurope, d’obtenir 
de phis grandes facilitcs pour Tanalyse des marches en Am6rique 
latine. 

XJn obstacle dans la voie du progres est Ic manque d’instituteurs et 
d*6tudiants des aspects techniques du sondage de Topinion publique 
en Amerique Latine, car la majorite des probJernes doivent en pratique 
etre resolus dans le pays ou le sondage a lieu. Un autre obstacle serieux 
est le manque de donnee^ statistiques, tant au niveau national que local, 
pouvant servir de base a rechantillonnage. 

On pent aussi considerer comme une cause retardatrice, la tendance 
de considei'cr cette nouvelle branchc d’aetivite statistique comme un 
instrument d’hommes de commerce et d’indiistrie plutot que comme 
une aide pour les sciences sociales. 

Cependant, il y a des signes d’avancement constant, Dans le do- 
maine de la statistique et des sciences sociales on observe un grand 
interet chez les savants de mieux connaitre et d’utiliser d’une maniere 
plus efficace le sondage de Topinion publique. Des demandes de rece- 
voir plus de publications sur la matiere parviennent constamment et 
nombre d’autorites et d’etudiants en Amerique. Latine ont recours 
aux moyens plus directs d’etude en s’associant avec ceux qui enseignent 
le sondage de Topinion publique.ou se livrent a des recherches sur cette 
matiere. Ij’enscignement de methodes d’echantillonagc a commence 
dans les Universites, des traites techniques sojit publics par des auteurs 
americains latins dans des periodiques scitmtifiques. 

La prudence est recommandee a ceux qui se livrent a des Bondages 
de Topinion publique en Amerique Latine, prudence que motive Fexpe- 
rience acquise dans les Etats-Unis et autres pays ou le sondage de Fopi- 
nion publique est plus largenient pratique. Bien qii’il soit exact que, 
dans certains pays, les sondages de I’opinion publique ont obtenu un degr6 
^leve d’exactitude, il est 6galement vrai que les techniques elabor^es 
dans un pays, ne peuvent pas etre utilisees dans un autre pays sansadap- 
itations et modifications prouvees necessaires par la recherche exp6ri- 
mentale. 

Pour favoriser le developpement des travaux de sondage de Fopinion 
publique en Amerique Latine, une action entreprise avec Faide de Flna- 
,titut Inter-Am6ricain de Statistique serait desirable. 



UNITED STATES METHODOLOGICAL 
RESEARCH IN PUBLIC OPINION 


by Samuel A. Stouffer 

Laboratory of Social Relational Harvard University {United States) 

Research to improve the methods of public opinion analysis is con¬ 
sidered by American scholars and practitioners as urgently important, 
for two reasons. First, the public opinion poll is now beginning to be 
recognized for what it really is—an instrument invaluable to the preser¬ 
vation of democracy. Second, public opinion studies properly planned 
and analyzed can help lay the basis for a science of social psychology. 
Before considering explicitly some of the recent American developments 
in public opinion research, let us look briefly at these two powerful in¬ 
centives. 

Democracy, to survive in a complicated industrial age, requires, among 
other things, swift and efficient methods of communication upward 
from the people to their leaders as well as downward from the leaders 
to the people. In both government and industry, the weakest part of 
the communication process has been the lines upward from the people 
to the leaders. Even such autocratic organizations as the Army re* 
cognized the need in wartime for better channels by which the desires 
and criticisms of the man at the bottom could be conveyed to top 
management. If this were true in the Army, how much greater is the 
need of democratic government to hear reliably from the people and for 
industrial management to hear reliably from workers or consumers. 

The traditional methods by which the people communicated to their 
leaders through the press and radio, through word of mouth and 
letters, through representation of organized pressure groups, and, of 
course, through free elections—will never be outmoded as long as de¬ 
mocracy lives. But these methods have now been supplemented by 
a new method, swifter and potentially more accurate than any of the 
others—the public opinion poll. Here the public temperature can be 

taken on a calibrated instrument. What the clinical thermometer_ 

whose universal use is less than a century old—has meant to the deve¬ 
lopment of modern medicine, the public opinion poll can eventually 
mean to the development of efficient democracy in an industrial age, 
Newspapers and radio may not always mirror public sentiment—the 
majority of the press, for example, were against Roosevelt, the majo¬ 
rity of the people for Roosevelt. Letters are notoriously unreliable, 
even when spontaneous and not stimulated by organized pressure groups. 
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Just before we entered the last war a count made of congressmen’s mail 
showed that it was overwhelmingly against drafting men for national 
defense; the polls showed more than two-thirds of the public in favor 
of the draft. Organized pressure groups are a necessity to make sure 
that minorities will be effectively heard, but the fantastic claims of 
general public support often made by these groups needs to be exposed 
to the cold white light of the facts. Free elections are at the core of 
democracy, but elections involve parties, personalities, and highly over¬ 
simplified and emotionally charged slogans and seldom constitute an 
expression of knowledge or attitude about specific issues. 

There are still some critics of public opinion polls who deplore them 
precisely because they are so effective in revealing the public mind. 
We can ignore those whose objections are based on embarrassment when 
the facts puncture the balloons of exaggerated or misrepresented claims 
made in support of pet causes. Harder to ignore are those sincere cri¬ 
tics who have a low opinion of the public mind and public tastes and 
who fear that frequent and accurate temperature readings will encourage 
cateiing to the lowest common denominator and discourage action which, 
though not necessarily popular at the moment, is ultimately for the 
public good. That this is happening both in government and in in¬ 
dustry, could not easily be refuted. But it can also be pointed out that 
efforts to educate the public are likely to be much more effective if based 
on accurate knowledge of the public’s specific misconceptions or alleged 
low tastes than if based on no information better than a hunch. And, 
here, lies one of the greatest opportunities of public opinion polls— 
not so much to show whether the public favors or opposes a specific 
issue as to show how well informed the public is about the issue 
and how specific kinds of misinformation are related to specific 
opinions. 

But the immediete practical job of making democracy more efficient, 
both politically and industrially, by improving the communication 
upwards from the masses to the leaders is only one of the incentives for 
improving our techniques. Another is the need of developing social 
psychology into a science. 

Of course, there are those who think that social psychology already 
is far advanced on the road to being a science. Avoiding quarrels over 
definitions of the word science, we probably can get considerable agree¬ 
ment, however, on the proposition that social psychology has few general 
theories which have been verified with such rigor that they can be applied 
with confidence to concrete situations. Some of the new tools developed 
in public opinion studies promise to speed up the day when the engi¬ 
neering applications of social psychology will be applications of tested 
theory and not simply applied common sense wisdom. 
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American research to improve the techniques of public opinion studies 
has by no means developed in isolation. It has drawn on work done by 
scholars throughout the world. We shall consider three areas of research: 
(1) the sampling of populations, (2) the sampling of items, and (3) 
analysis of opinion dynamics. The first of these, in particular, illustrates 
the great debt which research in the New World owes to scholars from 
the Old World. 

Public opinion research is made possible because a relatively small 
sample properly drawn will yield cheaply and quickly information appro¬ 
ximating what would be obtained from a survey of an entire population. 
Sampling theory rests on the solid base of decades of fundamental mathe¬ 
matical work by scholars in Prance, Germany, Italy, Scandinavia, Great 
Britain, and other lands. In particular, the developments of the past 
quarter of a century, with their focal center in England, have laid down 
the essential lines along which current statistical thinking travels. 
The largest American contribution has been in what might be called the 
engineering aspects, though, as the pages of such journals as the Annals 
of Mathematical Statistics eloquently testify, American scholars have also 
widened and deepened the fundamental thinking. 

Most polls in America today use what is called the quota method of 
sampling. The sampling is stratified by selecting demographic charac¬ 
teristics, such as region, age, sex and economic status, proportional to 
known population figures. The interviewer in a given locality is assigned 
a quota—so many in each age, sex, and economic group, for example. 
From this point on the interviewer is on his own. He makes his own 
selection of respondents within this quota. Of course, he is warned 
about various ways in which bias can creep in, and there is often a re¬ 
trospective attitude check on his work. For example, if he asks, “Whom 
did you vote for in the last presidential election?” the figures from 
a national sample if unbiased, should closely approximate the known 
national figures. 

The remarkable success which the polls have had in forecasting elec¬ 
tions is evidence that for many practical purposes the quota method 
of sampling may be good enough. However, there is at least one glaring 
weakness in the quota method. Since the final choice of respondents 
is discretionary with the interviewer, it cannot be said that it is at random. 
The magnificent paraphernalia of mathematical statistics do not strictly 
apply in the quota sampling operation.. When predictions can be checked, 
as at elections times, a practical test is available, but ordinarily there is 
no way of specifying precisely the sampling error or applying theories of 
statistical inference. Moreover, there are Varieties of situationv whei^e 
biases can enter in. 
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Some agencies, notably in government, have discarded the quota 
method in favor of what has been called the area method of sampling. 
The choice of addresses of respondents is no longer left to the discretion 
of the interviewer, who is instructed to call at a specific list of addresses 
drawn at random by the central office from a stratum of a prefabricated 
sample. There are special problems, such as the control of what res¬ 
pondent in a household a caller interviews or such as complications due 
to recall and substitutions, but the advantages of the area method lie 
primarily in the essential randomness of the ultimate selection of res¬ 
pondents. 

A study financed by the Rockefeller Foundation and sponsored by a 
committee of prac|itioners and academicians appointed by the Social 
Science Research Council and National Research Council is attempting 
to assess the relative advantages and disadvantages of these two methods 
of sampling and of combinations of the two methods. This study, now 
nearing completion under the direction of Professor Frederick F. 
Stephan of Princeton University, should clarify many of the issues, 
including the exceedingly important one of comparative costs, although 
many more years of research and experience will be necessary before 
definitive answers to all the complicated questions may be expected. 
The same committee of the Social Science Research Coimcil and National 
Research Council is also sponsoring an extensive study of interviewers’ 
bias, which is under the direction of the National Opinion Research 
Center, using funds supplied by the Rockefeller Foundation and Mr. 
Marshall Field, who has had a long interest in the improvement of 
public opinion studies. This project involves, incidentally, a good 
deal of actual controlled experimentation in which efforts are made to 
induce biases in order to see more clearly how they operate. 

Other studies are in the planning stage, notably a study of the advan¬ 
tages and disadvantages of repeated interviews through the use of panels. 
An idea of the large scope of practical work in this field—such as con¬ 
sumer inquiries for industrial concerns including publishing houses—now 
going on in the United States may be had by considering the fact that 
upwards of a hundred panels are operated currently by New York market 
research organizations alone. Through panels it is possible to study 
changes in attitude of the same person and. thus relate changes directly 
to other characteristics of the individual. The study now being planned 
of panel operations may open some new vistas not only for practitioners 
but also for acadenicians interested mainly in the developments of 
social science. 

Having discussed some of the directions of interest in research which 
is concerned primarily with the theoretical and practical problems of the 
sampling of populations, let us now turn to another area, pamely, the 
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sampling of items. There are an indefinitely large number of ways in 
which questions can be asked to elicit a given experience or attitude. 
Moreover, it is easy to multiply examples of how seemingly similar ques¬ 
tions will yield strikingly different responses. The better commercial 
practitioners are very well aware of this and when possible pretest their 
questions before going into the field, as well as use duplicate or tripli¬ 
cate forms of question wording. Nevertheless, there is often a wide 
latitude for interpretation, not only of the meaning of a question but 
also of the intensity of the response. 

To overcome these hazards, there have been two main lines of deve¬ 
lopment, quite different in nature. One approach, which perhaps has rea¬ 
ched its highest point of development in the work of Hr. Rensis Likert 
of the University of Michigan, and his associates, is to introduce much 
more informality into the interview than in conventional polls. The 
interviewer, more highly trained than the conventional interviewer, does 
not ask a fixed set of questions, but in effect, visits with the respondent, 
asking informally whatever questions seem appropriate to the situation 
and finally building up from the respondent's detailed responses an im¬ 
pression of what his opinion on a subject is and how strongly it is held. 
A very detailed report of the conversation is sent to the central office 
where it is analyzed and summarized by expert coders. This operation, 
which can cost up to $25 or more per interview, is thought too expen¬ 
sive by many practitioners for wide-scale use, but it has yielded some 
very convincing results and seems to be of particular advantage in situa¬ 
tions where attitudes are not sharply focussed or where numerous con¬ 
tingencies must be separately evaluated before a prediction can be safely 
made. An example of the type of situation in which the open-ended 
interview has been notably successful is in the investigation of respon¬ 
dent’s general buying expectations in the year ahead. Although pre¬ 
dictions made by this procedure can be checked against subsequent fact 
and although on numerous occasions incidental information obtained 
by informal interviews has been found to correspond closely with inde¬ 
pendent data (for example, money said to be in the bank), the great am¬ 
ount of discretion left to the interviewers and coders has opened some 
perils of its own, as compared with the more conventional methods. That 
the method is ideally suited for preliminary scouting studies on small 
samples or for supplementary spot checks to help interpret material 
much more cheaply obtained by the conventional methods, it is gener¬ 
ally agreed. 

A different approach to the problem of surmounting the hazards of 
individual check-list items is to use several such items in some form of 
a scale. There are many possible kinds of scale. One scale may merely 
order respondents. Another may order jespondents on either side of 
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a zero point. Another may order respondents on a scale with a metric 
like a thermometer on which the zero point is arbitrary but in which in¬ 
tervals arc equivalent—for example, the interval between 15 and 10 
could be psychologically equivalent in magnitude to the interval between 
10 and 5. Finally, in the latter scale a psychologically meaningful rather 
than arbitrary zero point might be introduced. 

A detailed review of the American research on scaling would carry us 
far beyond the scope of this paper. The commercial polls have as yet 
made little use of scales, but research on the subject is very much alive. 
The best known of earlier attempts were those initiated twenty years 
ago by Professor L. T.. T h u r s t o n e of the University of Chicago, 
adapting psychophysical techniques first developed in Germany. Two 
main methods were develoi)ed—one based on paired comparison and 
one based on equal appearing intervals. Using with the paired com¬ 
parison what Thurstone called the law of comparative judgment, one 
could obtain and test for interval consistency a scale in which intervals 
were made psychologically equal. 

During the war, the need for a simple techni(jue whic^h would employ 
a small number of check-list items led to a reconsideration of basic theo¬ 
ries underlying attitude measurement. In the Research Branch of the 
Information and Education Division of the War Department, which 
was polling American soldiers all over the world, a new approach was 
developed, mainly under the leadership of Professor Louis G u t t m a n 
of Cornell University. 

Guttman’s model is quite simple. Suppose you ask a man three ques¬ 
tions, each of which he can answer Yes or No: 

“Arc you over 6 feet tall?” Yes. No. 

**Are you over 5 feet 6 inches tall?” Yes. No. 

“Are you over 5 feet tall?” Yes. No. 

If the answers to all three questions arc consistent, respondents will be 
perfectly ordered into four groups, those 6 feet and over, those 5 feet 6 
to 6 feet, those 5 feet to 5 feet 6, and those under five feet. Moreover, 
if we know a man’s rank—that is, in which of the four groups he belongs 
—we can from the mere knowledge of the rank reproduce his answers 
to all three questions. Thus the man who is in the group 5 feet 6* inches 
to 6 feet must answer the first question No and the other two Yes. 

This model can be used with attitude term items, if the attitude is on 
a single dimension. In fact, its greatest utility may turn out eventually 
to be the identification of the context in which a specific attitude item 
belongs. Response to a series of items must be such as to permit their 
ordering in a cumulative way. Thus, a person who checks Yes to Item 
A, to which the fewest people check Yes, must also check Yes to all other 
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items in the list. Scales developed by this method were quite exten¬ 
sively used by the War Department, and have since been tried on other 
studies. It should be noted that the procedure yields only an ordering 
and does not yield a metric. An extension of the technique through 
the introduction of an intensity functioti, led to the development of a 
z 3 ro point. In instances when the exact zero point could not be reliably 
determined, a “zero region’' could be indicated. 

Also growing out of the' War Department’s work was a different app¬ 
roach to the scaling problem. This is the latent attribute technique 
developed by Professor Paul F. Lazarsfeld of Columbia University. 
Taking oS from the earlier Spearman work in England on factor 
analysis, Lazarsfeld has developed, for what seems to be the first time, a 
sound technique for factor analysis with qualitative data. Applying 
his model to attitude data, he considers the response to an item belong¬ 
ing to a one-dimensional scale to be an expression of a latent attribute 
plus a residual. If the residuals are independent, it becomes possible to 
order respondents to several items according to the probability with which 
they possess the latent attribute. This approach has very interest¬ 
ing possibilities. In practice it has been found that items which form a 
scale by the Guttman techniques do not form a scale by the Lazarsfeld 
technique, and vice versa. A good deal of progress has been made in 
analyzing, mathematically, the relationship between these two different 
models and also between them and the earlier work of Thurstone. The 
whole subject will be reviewed in detail in Volume IV of a forthcoming 
series of studi3s growing out of the work of the Research Branch of the 
War Department. This report is prepared under the auspices of the 
Social Science Research Council, 230 Park Avenue, New York City. 

It is possible that still better approaches to the scaling problem will 
be developed. .World War I gave a considerable impetus to the deve¬ 
lopment of intelligence measures and achievement measures and it is 
likely that World War II will have given a similar impetus to develop¬ 
ment of measurement of opinion and attitudes. A large amount of 
concerted work on this problem may be expected in the next few years. 

We have spoken briefly of research involving the sampling of popula¬ 
tion and the sampling of items. We close now with a few words on 
studies of the dynamics of opinion. In spite of the fact that a number 
of textbooks and treatises are available on public opinion, and in spite 
of the wisdom of politicians and the insights of such experts as the late 
author of Mein Kampf, the tested hypotheses are few indeed. 

There is now in Ara3rica a spirited interest in reformulating the whole 
theory of the formation and changing of public opinion in operational 
concepts which can be put to empirical test. University centers in which 
there is particularly active concern with the problem include Columbia, 
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Princeton, Michigan, Cornell, Chicago, University of Washington, 
Yale, and Harvard. The subject is being approached from several di¬ 
rections, of which four may be briefly noted. One is to assemble in a 
single archives the punch cards from hundreds of surveys—as has been 
done by Professor Hadley Cantril at Princeton—and by exploring 
this vast mine to obtain comparative data which will at least give us 
some preliminary answers to general questions. Another is to make 
careful repeated interviews on a large panel of respondents at a critical 
period—as was done by Lazarsfeld of Columbia in an election year 
—and note who changed his opinion and with what that change in 
opinion seemed to he related. Still another approacih is under way 
at the Harvard Laboratory of Social Relations, where a handful of 
individuals has been studied with very intensive clinical techniques 
over a period of several months, involving spending thirty hours with 
each respondent. Psychologists, anthropologists, and sociologists 
have collaborated in this study, which is merely a preliminary one for 
the purpose of formulating more promising hypotheses, some of which 
are now being further explored with a larger sample. Finally, progress 
has been made in the testing of some hypotheses by actual controlled 
experiments. There is quite an extensive literature on experimental 
studies of attempts to change attitudes by movies, film and radio, or 
in the classroom. In the series of volumes reporting on the work 
of the Research Branch in the War Department during the war, 
Volume III will be devoted to problems of making exx)erimental studies 
of the effects of film and radio in changing attitudes. Further experi¬ 
ments are under way, notably in the Department of Psychology at 
Yale, under the direction of Professor Carl H o v 1 a n d and Mr. Arthur 
Lumsdaine. Social psychologists are coming more and more 
to realize that about the only sure test of a hypothesis in our field is 
provided by the controlled experiment. .There are many difficulties 
particularly in designing situations which are not defeated by their 
artificiality. And this work is very expensive. But it must be done 
if we are to have not mere insights and guesses but a science of social 
psychology. 

In all too cursory a manner we have reviewed some of the develop¬ 
ments in public opinion research in America. In comparison with 
millions spent annually in application of the methods, the money 
spent in research to improve the methods is, of course, quite small. 
But there never has been such an impetus for research as at the present 
time. Much is owed to the contribution of scholars from other lands. 
By keeping open our international lines.of academic communication, 
through journal publications, through UNESCO, through gatherings 
such ^ this today, we can increase our exchange ot ideas ^nd 
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experience. And all of us can share in the satisfaction of knowing we 
are forging new tools of democracy which can help—if ever so little— 
both to build social science and to contribute, through strengthening 
democracy, to the peace of the world. 


R4suin4 

La recherche en vue d’am6lioror les m6thodes de sondage de Topinion 
publique est consider6e aux Etats-Unis tant par les th6oriciens que 
par les praticiens, comme etant d’une importance capitale et cela pour 
deux raisons. Tout d’abord Ton commence ^ reconnaitre que le sondage 
de 1’opinion publique est un pr^cieiix moyen de conservation 
de la democratie, complement des methodes traditionnelles par lesque- 
lles le peuple exprime ses desirs et ses opinions a ses dirigeants. En 
second lieu, les etudes de sondage de Topinion publique peuvent aider 
& poser les fondements d’une science de la psychologic sociale. L’au- 
teur envisage trois champs d’investigation concernant la m^thodologic 
de sondage de Topinion: (1) La methode d'echantillonnage de la popular 
tioUf avec des considerations sur les avantages et les desavantages rela- 
tifs des methodes dites de quota-sampling et de area-sampling dans le 
sondage de Topinion; (2) Le choix des questions d'enquete, avec une dis¬ 
cussion du progr^s recent et vraimcnt frapp Ant du developpement de 
modMes math^matiques pour revaluation des attitudes; (3) Uanalyse 
de la dynamique de Vopinion^ au moyen de T^tude comparee des donnees 
de Bondages d’opinion fournies par les archives; au moyen de Bondages 
r6p6t6s montrant quel est le genre de jjersonnes qui changent d’opinion; 
et par des experiences controlees d’influencer les opinions au moyen de 
films, de programmes de T.S.E., d’enseigneinent scolaire. Les recher- 
ches ain6ricaines ont fait grand usage des precedents travaux des savants 
europeens, 6t en particulier de ceux qui concernaieiit le developpement 
de ia theorie de rechantillonnage. L’usage, trfes repandu aux Etats- 
Unis, tant par les institutions privees que par le gouvernement, des tech- 
niques de sondage de Topinion a fourni des encouragements, des donnees 
de base, une experience pratique, et une aide financifere & Peffort con-, 
certe actuel qui tend A ameiiorer la recherche methodologique. L’- 
usage de )a technique du sondage de I’opfnion dans Tarmee americaine, 
quj. fera robjet d’un rapport en quatre volumes que dgit publier le Con- 
^eii de Recherche des Sciences Sooiales^ est qn e^emple de la fa 9 on dont^ 
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les besoins pratiques ont stimuW le developpement technique. De meme 
que la premifere guerre mondiale avait donn6 une forte impulsion au 
developpement, en Am^rique, de Tam^lioration des moyens de mesurer 
Tintelligence et les prestations, il est probable que la deuxifeme guerre 
mondiale aura pareillement stimule le developpement des techniques 
d’6valuation de I’opinion et des attitudes. Parmi les centres univer- 
sitaires, oh les recherches en ce .domaine sont le plus activement pous- 
s6es, se trouvent ceux de Chicago, de Columbia, de Cornell, de Harvard, 
de Michigan, de Princeton, de TUniversit^ de Washington, et de Yale. 
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Discussion 

Mr, Abrams suggested that the definition of public opinion research 
be broadened so as to include more than public opinion institutes. 
He indicated three broad categories in which work is currently being 
done in England: (1) the Government, concerned with attitudes affected 
by government social actions; (2) semi-governmental bodies, potably 
the British Broadcasting Corporation in the fields of program planning 
and listener research; (3) ordinary commercial organizations which 
do three types of work: (a) research work for the Government, especially 
on political issues; (b) market research- and surveys in areas of public 
controversy; and (c) research for philanthropic foundations. 

Mr. Abrams pointed out that public opinion research originated in 
England in social surveys, rather than from election forecasting as in 
the United States. Early surveys were in the field of housing. 

Mr. Abrams indicated that most of the British survey-directors were 
originally economists; no outstanding director is a statistician or psy¬ 
chologist; their training has been primarily in business. There has 
been very little publication of results because work for the government 
and private commerce must be secret. 

The bulk of British surveys, said Mr. Abrams, are made on quota 
samples. Some work has been done with systematic sampling from 
lists. 

Mr. Abrams stated that for Britain quota samples are not wholly 
reliable because suj0&cient statistics are not available for the establish¬ 
ment of valid quotas. With respect to the control of interviewer and ques¬ 
tion bias, he cited two devices in use in England: (l)“dummy informants” 
—in a list sample, each interviewer is assigned a few respondents who 
have been drilled in advance on their answers (2) repeated inter¬ 
views by the supervisor. A third development has been in the direc¬ 
tion of intensive interviews with long questionnaires. This movement 
toward the study of the origin and purposes of opinion is, in Mr. Abrams’ 
opinion, a result of the orientation of opinion research around problems 
of social policy. 

Mr. Eadvanyi discussed the work of the “Scientific Institute of 
Mexican Public Opinion,” which he described as better established than 
similar organizations in Latin America. Employing students from the 
National University of Mexico, it makes surveys on national and inter¬ 
national economic, social, political and culturajf problems. A second 
organization, the**Institute for Studies in Public Opinion and Attitudes,” 
investigates methodological problems, and maintains contact with ex¬ 
perts all over the world. 
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Mr. Radvanyi announced that the Mexican Institute, recognizing the 
importance of international opinion research, is publishing the Internd^ 
tional Journal of Opinion and Attitude Research and is preparing an 
Interwxtio'ml Directory of Opinion and Attitude Research. 

Mr. Radvanyi proposed for consideration, in connection with inter¬ 
national pooling, the following statements: (1) Identical procedures ) 
cannot be established for all countries. (2) Major conditions determi¬ 
ning methods are cultural traditions, economic and social development, 
political situations, and degree and content of education and information. 

(3) Language differences may force the use of different questions to 
achieve the same effect in different countries. (4) Answers to the same 
question may have different meanings in different countries. (5) Different 
attitudes toward polls exist in different parts of the world, sometimes 
facilitating, sometimes rendering difficult the work of surveying. (6) 
“No opinion” and refusal to answer may have different meanings in dif¬ 
ferent social and cultural backgrounds. (7) In some countries, for 
various reasons, false answers are given instead of “no opinion” or “no 
answer.” (8) “Quota controls” valid for on3 country may not always 
be transplanted to another. (9) Work is needed to make “area sampling” 
feasible where maps and other data generally utilized are not available. 
(10) Study is needed to determine appropriate interviewing techniques 
for different countries. (11) The main concern must be to obtain valid 
and commensurable results in all countries. (12) The newly-formed 
World Congress for Public Opinion Research must work with the Inter¬ 
national Statistical Institute on the organization of international opi¬ 
nion surveys. 

Mr. O’G r a d y stressed the importance of research on the choice of 
topics for opinion studies, to determine the priority of areas of socially 
significaht attitudes. An example is the increasing attention to measure¬ 
ments of the extent of ignorance and misconceptions. 

Mr. O’Grady drew attention to a field of research related to the study 
of opinion dynamics: the measurement of what opinion-forming forces 
are influencing given situations. Public relations research and commu¬ 
nications research contribute in this direction. 

Mr. Likert commented that he believed it unfortunate that the 
narrow term “public opinion research” has been used for the important 
social science research tools developed in the field of “survey research.” 
In addition to opinions, data are collected by means of surveys on: (1) 
The extent of information, misinformation, and ignorance; (2) the be¬ 
havior of people; (3) the experience of people; (4) motives; (5) economic,^ 
demographic, and social facts; (6) the relation between attitudes, infor- 
mation, etc., and behavior. Mr. Likert noted the use of surveys in mea¬ 
suring situations before and after experiments. 
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Mr. Likert made some general observations on the work being done in 
the United States, urging that commercial organizations be encouraged 
to publish (or make available for research workers) their results and es¬ 
pecially their methodological findings. He concluded with the requests 
that sampling techniques be used which permit of the measurement of 
error, and that design of experiments and training of interviewers be 
improved. Interviewers must be enabled to establish and maintain 
rapport with respondents; something of the nature of free-answer inter¬ 
views must be used to clarify what the respondents mean. 

Mr. Tagliacarne added a few words concerning the Acta Insti¬ 
tute in Italy, a private organization whose director is one of the few statis¬ 
ticians to hold such a position. The Institute, employing 300 inter¬ 
viewers, usually uses long questionnaires; it has studied various econo¬ 
mic, social and political topics. Furthermore, the Acta Institute pub¬ 
lishes its data with full detailed analysis. 

Mr. Herrington referred to his experience in dealing with lan¬ 
guage problems in questionnaire development, through the use of preli¬ 
minary interviews where the subjects of investigation are discussed 
informally. Another experimental technique has involved word- 
associatibn. 

Mr. LinaCampos made a concluding remark on the need for 
international collaboration in this field. 
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Although social insurance systems in the modern sense of the term 
are now over sixty years old, no comprehensive international statistical 
series have been authoritatively developed which would enable valid 
comparisons to be made of the relative status and progress of the social 
security programs of the different countries. Many factors have contri¬ 
buted to this situation among which are changing economic and political 
conditions and frequently changing social security laws. But of primary 
importance to statisticians and economists is the fact that the absence 
of essential series on national income, labor force, family income, and 
related items has restricted international comparisons on a relative basis 
to a limited number of countries on a limited number of aspects, and to 
a very limited number of times, usually when very special studies or 
investigations have been undertaken. 

Absolute figures on such important matters as coverage, contributions, 
beneficiaries, amount of benefits, and on similar topics have been collected 
and published from time to time by the International Labor Office. 
These have served as a valuable basis upon which students in various 
countries have compiled relative figures such as: the ratio of coverage 
under the social security program to the total population of different 
countries; contributions as a percentage of payrolls or national income; 
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beneficiaries as a proportion of the number of persons experiencing the 
different risks; or benefits as a percentage of average wages. 

While absolute figures are essential in themselves for internal evalua¬ 
tion of the effectiveness and scope of social security programs in each 
country, because of the differences in the size of the various countries, 
the character of their economy, and the widely differing scope and level 
of adequacy of the social security programs, a valid statistical series of 
relative values should be carefully developed. Any such series of items 
would still require qualification and critical analysis before. being widely 
used, but they would supply a greatly needed resource in the studies now 
underway in all parts of the world tending toward making social secu¬ 
rity universal in coverage and protection and simplified in administra¬ 
tion. 

One reason why in recent years it has become more difficult—and at 
the same time more essential—to make international comparisons is the 
diversity and complexity in the types of social security programs in 
operation. Twenty years or so ago, social insurance systems tended 
more along the lines of the “ classical ” type developed by Bismarck in 
Germany or Lloyd George in Great Britain. Today, the newer systems 
and those recently revised tend more in the direction of combining a 
number of programs together in a comprehensive, unified system with 
cash benefits, and services (medical, employment, rehabilitation), and 
with financing and administrative arrangements which are not easily 
classified. The Beveridge Plan in Great Britain and the New Zealand Plan 
are illustrative of the newer types of social security plans which by their 
unity may make detailed statistical classifications more difficult in some 
respects than under the older type of system. 

In developing more comprehensive and unified social security systems 
it has become apparent that more than just the social security system 
of a country must be taken into account in framing, modifying, or e va- 
luating social security legislation. Special systems for particular groups 
of workers, public assistance programs and programs for veterans, their 
dependents and survivors—all have a “ social'' purpose and must be 
taken into account. 

I venture to predict that as the standard of living of a country increa¬ 
ses, its overall social security program—that is, all public and private 
programs-^will become more diversified and complex just as the eco¬ 
nomy in general becomes more complex as it becomes industrialized. 
The task of making international comparisons will become more com¬ 
plex, therefore, and all the more important. 

This diversity in the institutional framework of social security means 
that more than one type of statistical series must be developed to show 
the changing, diversified, complex pattern. This calls for more basic 
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data and simultaneously for more sample surveys, estimates, and ad- 
venturing into unknown fields. Statisticians wiU have to enter where 
both fools and angels fear to tread. 

There is only one way to begin to learn to walk and that is to take the 
first step. A number of persons in different countries have been working 
on the development of national statistical series for their own social secu- 
rity programs. No valid international comparisons can be made with¬ 
out the national series. From the experience developed by those coun¬ 
tries with national series we may be able to develop not only valid in¬ 
ternational comparisons but at the same time more useful revised natio¬ 
nal series. 

It is to be hox>ed, therefore, that the appropriate national and inter¬ 
national social security agencies in conjunction with the appropriate 
international statistical institutes and the International Labor Office can 
work together closely to evolve a statisticarseries which can form a valid 
basis for international comparison. 

Some progress has already been made in the field of health statistics 
which are of importance to health insurance comparisons. Progress has 
also been made in the field of unemployment statistics which are of im¬ 
portance to unemployment insurance comparisons. Progress in various 
countries in the development of other statistical series on wages, natio¬ 
nal income, and labor force indicate that a real possibility exists for 
making such comparisons—and also for utilizing social security data 
more effectively in making estimates on such basic matters as the total 
wage and salary payments in the nation, national income, labor force, 
and total population. 

The progress recently made at meetings of the Statistical and Medical 
Commissions of the Inter-American Committee on Social Security with 
representatives of the Inter American Statistical Institute and the 
International Labor Office indicates that there is an important task 
for statisticians, economists, doctors and other professional personnel 
interested in making valid international comparisons. This task is 
to set guides so that the newly established social security systems may 
take advantage of the experience of the older systems; so that all 
countries may profit from the many years of accumulated experience 
and establish statistical series which will be of value in the future com¬ 
parison, evaluation and improvement of their programs. 

Innumerable problems and difficulties confront those who attempt 
to define the bases upon which a series of relative statistical values can 
be compiled for international comparison. Those of us who have been 
concerned with framing the legislative provisions of social security pro- 
grams or administering social security programs know the value which 
many statistical series hfitve at a crucial point in determining policy, 
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but which frequently cannot be obtained or if obtainable are often so 
limited as to be of doubtful value. A complete listing of all our needs 
would fill an immense volume. I can only suggest that it might be best 
to begin modestly and obtain agreement first on some essential and com¬ 
paratively easy items. Then building on this experience agreement 
could be obtained upon the more complex items. 

Illustrative of what I mean by the comparatively easy items are those 
relating to population coverage. Beneficiary coverage ratios are more 
difficult and ratios relating to the adequacy of benefits are exceedingly 
difficult. In the field of financing there are several ratios which are not 
too difficult to obtain although a longer time series is necessary for the 
ratios to be useful for international comparison. I shall refer to each 
of these four types of comparison very briefly. 


Population Covsraoe Ratios 

Although the newer social security systems-r-and amendments to the 
older plans—are tending in the direction of providing universal coverage., 
some program in every country excludes some persons from coverage. 
Even when the universal risks such as old age, death, or ill health apply 
universally, the risk of unemployment relates only to persons in the labor 
force. Originally, social insurance developed as protection to wage- 
earners but in recent years the scope of protection has broadened so that 
coverage against the universal risk is being applied to the self-employed 
(small businessmen, professional persons, farmers, artisans, independent 
merchants). In order to measure the scope of coverage of the plans of 
various countries it is important to have a measure of the relative number 
of persons given protection against a specified risk. The number of persons 
who have protection against a particular risk not only depends on the 
industrial, occupational, or regional coverage of the insurance plan, 
but also on the liberality or restrictiveness of the eligibility (and related) 
provisions of the system in relation to employment and compliance. 
Since the eligibility conditions usually vary as between different risks 
it is necessary to establish a coverage ratio for each separate risk. It is 
also necessary in some systems to select more than one date to obtain 
a valid international comparison because eligibility conditions may be 
related to calendar or fiscal years which may affect the ratio markedly, 
particularly in periods of rapidly changing employment conditions. 

The problem of preparing a count or an estimate of the number of 
insured persons will be more difficult in those countries with many 
systems. Particularly in countries like the United States where many 
persons may be insured under more than one public system, an 
^estimate is nec^saryto eljminate duplication. 
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A population coverage ratio can be published regularly once or twice 
a year only if reasonably accurate population estimates for such dates are 
available. For unemployment insurance, (and for temporary disability 
insurance) a labor force estimate is required—possibly with flie self- 
employed and agricultural labor separately totaled. For old age 
insurance the adult working population could be used. For permanent 
disability insurance, survivors insurance,^ and health insurance the 
number of insured and their dependents could be computed as a propor¬ 
tion of the entire population. 

It is obvious that any population coverage ratios will not only involve 
a frequent count or careful estimate of the number of primary persons 
insured but also the number of dependents of the insured, and the labor 
force and total population both with at least a minimum number of 
classihcatibns for more refined comparison. 


Bbnefk’iary Coverage Ratios 

Another broad type of comparison to which study should be given 
is what I have called “beneficiary coverage ratios.” Such ratios would 
be the proportion which each type of beneficiary constitutes of the 
total number of persons experiencing a given risk. For old age, the ratio 
would be the percent which aged beneficiaries comprise of the population 
age 60 or 65 years and ovdr depending on the retirement age. For 
survivors insurance, the measure could be the percent which paternal 
orphans represent of all such orphans under a given age. Other measures 
can be devised for other classes of survivors such as widows or parents 
but the most important single measure is for children. 

For disability, the problem is somewhat different and more complex. 
Most disability systems are developed around the earnings loss concept, 
that is, they involve loss of earnings due to cessation of employment 
as a member of the labor force. The basis of comparison for disability 
might well be, therefore, both the total number of persons incapacitated 
(separately for the temporarily disabled and the permanently disabled) 
and the number of persons of adult age who were members of the labor 
force until their disability. In the absence of such an estimate, coverage 

' Another type of interesting relative international comparison would be the 
proportion in each country which the face value of the survivors insurance repre¬ 
sents of the grand total of all survivors (life) insurance (public and private). This 
type of comparison illustrates the kind of series which should be developed to show 
the relationship between governmental provisions for social security and P^’^^ate 
provisions with the same general objective. For old age, a few countries naight be 
able to develop a ratio of the number of persons insured who also are insured under 
supplementary systems for additional protection, ^ 
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could be expressed iii terms of the number of disability beneficiaries per 
100,000 persons employed, or per 100,000 persons (or males) between 
18 and 64. 

The base for beneficiary comparison in the field of unemployment 
insurance would be the total number of unemployed and for children’s 
allowances, the total number of children. For health insurance no single 
pleasure is appropriate but it may be that some study and experimentation 
would yield a minimum number of ratios which would be easy to 
produce and at the same time meaningfu]. For instance, the proportion 
of days ofhospitalization for insured persons to the total number of days 
of hospitalization for the entire population might be of interest. 

Comparisons in the health field must be so much more detailed than 
those for cash benefits that I have deliberately omitted any detailed 
reference to them in this paper. They are important and complex 
enough to warrant special treatment. However, I should like to refer 
again to the pioneering work on health statistics of the Statistical and 
Medical Comniissions of the Inter-American Committee on Social Security 
and to point out that their recommendations will be discussed at a full 
meeting of the Inter-American Conference on Social Security in Rio 
.de Janiero this fall. 


Adequacy of Benefit Payments 

The most important single comparison among social security systems 
is with respect to the amount of the benefit. Since the various laws 
utilize many different formulae for the computation of benefits (flat rates, 
wage classes, percentage of wages) with varying increments for dependents 
and years insured, it is exceedingly difficult to determine the level of 
benefits paid and even more difficult—^if not impossible—^to determine 
the adequacy of the benefits. These matters are exceedingly difficult 
to determine in any single country. An international comparison is 
even more hazardous. 

Is an international comparison of benefit payments then impossible ? 
I do not think so. I believe that we could produce some useful ratios 
that would be meaningful in evaluating the programs of the different 
countries. Since the general objective of social security benefits is 
to replace lost income, it is wholly appropriate that the payment be 
related to some type ofincoire in the country-swages, for instance. The 
basis of comparison would then become the percent which the average 
benefit (for a certain class or classes of beneficiaries) represents of the 
average wage in the country, or, if that is not available, of the average 
wage in manufacturing, or the average wage of persons contributiig 
to the insuraace system, Such an appiroach has the merit of holding 
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constant wage levels, price levels, standard of living, and other measures 
of the well-being of the nation, and keeping the comparison to the 
place of the benefit amount within the frame of reference of the national 
standard of living. 

It does not, however, enable one to judge the effect of such a benefit 
since , the relation of income to a minimum standard of living might 
require a benefit of 100 percent of wages in one country and only 35 
percent in another.. Here, as in many other respects on the comparisons 
mentioned in this paper, careful qualitative analysis and other supporting 
statistical data must be used to supplement any* single statistical series 
for effective use. 

Study might be given to whether there would be any value in a 
comparison of average benefits to a statutory minimum wage. Because 
of the character of some national minimum wage laws it may not be 
practical to develop any such comparison generally. 

The most meaningful comparison would be the relation of average in¬ 
come in beneficiary families from all sources (social security benefits plus 
all other types of income) to the average family income in the nation 
as a whole, or among certain types of families. This is an exceedingly 
difficult task. It requires careful sample studies of beneficiaries’ incomes 
as well as statistics on family incomes for the nation as a whole. Such 
comparisons might‘be attempted for a selected group of countries for 
predetermined dates. 

The study of the adequacy of social security benefits is the mo.^t 
difficult of all of the areas in social security because of the subjective 
character of adequacy.” Yet, some objective tests can be established. 
The combined efforts of many professions are necessary to accomplish 
the result. Studies leading to some acceptable standards of family 
income adequacy may make it possible to relate average income in bene¬ 
ficiary families to such standards. Here is an important and controversial 
area of work which awaits exploration. It may not be possible to achieve 
. a satisfactory comparison along these lines, but the recent development 
of economic and social studies as a result of the interest in post-war 
reconstruction and the work of the United Nations may make it possible 
to attempt something that may produce some variation which will have 
some value. 


Finances of Social Security 

One question that is always asked about a social security program 
is, how much does it cost? Many answers are usually given to this 
question, but not always a very meaningful answer. The amount of 
money set aside in a particular year for benefits, or the amount spent 
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on benefits, will not answer the question intelligently by itself. Here^ 
as in other comparisons, more than one type of comparison is essential 
if we are to develop a full answer to the question asked. 

One set of ratios that should be developed would be contributions 
and benefits each as a percentage of national income for single years, 
and as an average for five or ten year periods. For unemployment insurance 
an agreed upon period of eight or ten years could be used. For long 
run risks like old age, a much longer period might be used. 

^n average cost over a number of years might be developed by relating 
benefits to the taxable payroll for each insurance program. 

Summary of Data Needed for Valid Comparisons 

The comparisons mentioned in this paper are merely illustrative and 
suggestive of the tremendous possibilities and opportunities which exist 
for advancing the work of evaluating and improving social security and 
its contribution to the national and international welfare. 

Innumerable other comparisons have been made for selected social 
security programs or could be made among those with certain common 
features. It is, for instance, possible to develop many interesting and 
valuable comparisons among systems that have the common feature of 
flat contribution and benefit provisions; or, on the other hand, which 
have contribution or benefit provisions measured as a percentage of 
wages. But the task which I have tried to deal with is one of 
attempting to develop measures which could be applied to all types 
of systems. ’ 

Administrative personnel and costs is a subject in which there is a 
great deal of interest—and misinformation. The tremendous diversity in 
the patterns of administration, the interlocking of various social security 
programs, and the relation between social security and other public 
or quasi-private institutions makes statistics on administrative personnel 
and cost difficult to obtain and when obtainable easily subject to misuse. 
I have not the time here to go into this important subject but I believe 
it important and worthy of separate consideration. 

Although I have touched upon only a very few comparisons I should 
like to summarize the types of data needed to make international com¬ 
parisons in the field of social security. By relating such a listing to the 
data now available in various countries we will have a kind of balance 
sheet of gaps in our information requiring attention. 

First, with respect to the social security system itself, we would need 
data on the number of beneficiaries, by type of risk, classified by age, 
Bex, familial status; the number of families in which beneficiaries live, 
by size and composition; the number of persons insured against specified 
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risks, by risk, and by age, sex, and familial status; benefit rates and 
average benefit, by risk; average family benefit, by risk, and by 
family size and composition; average family income of beneficiary families 
from all sources, by risk, and by family size and composition; social 
security fund income, by source and by risk; expenditures for social 
security, by object, by risk. 

With respect to other types of data needed, the following may be 
mentioned: total population, by age, sex, familial status, dependency 
status; number of persons in the labor force, by employment status, age, 
sex, familial status; number of persons disabled on an average day, by 
type of disability (i.e., long or short-term), age, sex, familial status, 
recent labor force status; average wage, for all employmsnts, or in speci¬ 
fied types of employment; minimum wage; average family income from 
all sources; national income. 
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Ditcuttion 

Mr. W o o d b u r y's remarks on Mr. C o h e n’s paper, read on his 
behalf by Miss R o d m e r, were developed from the point of view of the 
problems of assembling and compiling the data: 

The data on social security fall into three main groups: First, 
there are the data that form a record of the operations of the social se¬ 
curity programs—^Mr. Cohen’s absolute figures... These are indispen¬ 
sable, the raw materials of any national or international statistics. They 
lack, however, certain elements required to make them significant. 

""Secondly, there are the rates and ratios that measure risk and throw 
light upon the meaning of the several social security measures. In com¬ 
puting these for purposes of international comparison, account has to 
be taken as Mr. Cohen points out, of differences in the scope and provi¬ 
sions of the various systems. These rates are of different type. ...the 
scope of the figures must be comparable: This can be obtained, 
for example, by limiting figures to particular branches of economic 
activity.... ' 

“In the field of morbidity much greater difficulties are found.... The 
Statistical and Medical Commissions of the Inter-American Committee 
on Social Security, under the auspices of the International Labor Office, 
examined this matter with a view to arriving at a standardization of the 
sickness statistics established by social insurance institutions on this 
continent.... 

‘"The relation between age or sex and morbidity is well known. How¬ 
ever, elimination of the influence of differences in age and sex distribu¬ 
tion by standardization is not sufficient; rates must actually be given 
for age and sex groups as the relation is by no means constant.... 

“The incidence of specific diseases differs from one insured population 
to the other and a common classification by diagnoses is indispensable 
for purposes of comparison. 

“As in the case of accident statistics, the definition of the units includ¬ 
ed in each set of morbidity statistics frequently differs. The unit of 
illness or incapacitating illness recorded may be a spell of illness ending, 
or one beginning or one current during the period under review. Again, 
it may be an individual person suffering one or more spells of illness du¬ 
ring such period. Common definitions have to be agreed upon. Finally 
the meaning of the term “persons exposed to risk” to which the units 
of morbidity must be related if comparison is to be made, should be 
agreed upon, the time of exposure being generally deemed the most ap- 
propria^ measurement. As mentioned at a previous meeting, the Sta¬ 
tistical and Medical Commissions of the Inter-American Committee on 
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Social Security have proposed standard rules on these points. They 
have also set out and defined the data that are deemed desirable in * 
medical care statistics. 

‘‘In the field of unemployment the usual common measure is to com¬ 
pare the number of persons unemployed as of a given day with the total 
of employed and unemployed—the labor force—on the same day. An 
alternative method is to compare the days of unemployment during a 
given period, with the total number of possible man-days of work during 
the same period.... In practice, various modifications are found... There 
are also differences in the scope of the unemployment insurance systems, 
which seriously affect comparability.... 

“In all these calculations, the distinction must be kept in mind between 
statistics that bear upon the whole problem, such as accidents or unem¬ 
ployment, and those w’hich are specifically limited to social security 
measures, such as compensated accidents, sickness and unemployment. 
The latter are often used as a substitute for the former. While the for¬ 
mer type is always the more significant for purposes of analysis of the 
social phenomena with which they deal, the latter are useful with res¬ 
pect to the specific problems of coverage and risk involved in the social 
security program itself.... 

Thirdly, the ratios with which Mr. Cohen’s paper are specifically con¬ 
cerned deal with appraisal and evaluation. These are of primary impor¬ 
tance in policy making and for the appraisal of the social security 
systems as a whole and in their respective parts. The ratios proposed, 
however, are difficult to construct, since usually at. least one member 
of each ratio must be estimated. 

Each of the different ratios must be considerd by itself. To show over¬ 
all coverage of a system as a whole, for example, of old age protection, 
the number of persons covered by old age insurance can bo compared, to 
the total population over a given age, or to the wage-earning part of 
the population, if not an overall coverage but merely the w^age earner 
coverage is the point of concern. Such ratios then can be used to answer 
the question whether any important sector of the population is not 
covered, and thus furn'sh a basis for decision whethei modifications of 
the legislation are needed... 

“•••The problem, of course, is to obtain such a figure that can be 
accepted as a satisfactory estimate for purposes of comparison.” 

Mr. Cohen agreed with his critics that his suggestions are capable 
only of limited immediate application, but indicated that he hoped for 
development along the lines he proposed. 

Mr. S t o w m a n discussed the origin in the League of Nations of 
work on health indices, and stated that he believes the preliminary and 
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experimental work in this field is bearing fruit. He expressed the hope 
that the World Health Organization would be able soon to join its 
efforts with those of the Pan American Sanitary Bureau. 

Mr. Bernstein discussed his experience with a statistical study 
of the B.C.G. treatment for tuberculosis, during which a basis in the 
operation of the experiment rendered invalid the drawing of a positive 
conclusion from the statistics. Mr. Bernstein argued the great value of 
laboratory experiments made parallel with public health experiments. 



PROBLEMAS DEL DESARROLLO DE LOS INDICES 
DE SALUD EN AMERICA LATINA 

by Manuel de Viado M.D. 

Oficina ItUernacional del Trahajo 

La apreciacidn exacta de las condiciones de salud de una comunidad, 
estado, regidn, o pais, ha preocupado constantemente a los servicios 
de medioina pdblica que han recurrido, como medio de comparacidn, 
al uso de las estadisticas vitales. Uso que, como un medio de conocer 
el estado de salud coleotivo, tiene ya una tradicidn mds que centenaria. 
Sin embargo, a pesar de la antigiiedad de su uso y de los muchos trabajos 
realizadoB, la comparacidn de las estadisticas continiia siendo dificil, 
aumentando las dificultades a medida que, de la comparacidn regional o 
nacional, pasamos a una comparacidn internacional. 

La ausencia de datos importantes en algunas comunidades, regiones 
o paises; la diversidad de mdtodes de compilacidn o clasificacidn em« 
pleados; la variabilidad de los conceptos bdsicos de interpretacidn, la 
exoesiva multiplicidad de organismos interesados en estadisticas rirales; 
la diferencia de intereses y objetivos que animan a cada uno de estos 
organismos y, a veces, la falta de standards apropiados o la no existencia 
de una adecuada y moderna legislacidn estadistica, son algunas de 
las principales dificultades que se encuentran. 

Por otra parte, a medida que los grandes avences de la tecnica precisan 
los principios oomunes que los permitirdn llegar al goce del grado mdximo 
de salud, entendida como ** el estado de complete bienestar fisico, m^tal 
y social,” se ha ido comprendiendo la estrecha interdependencia que 
existe, en materias de salud, entre las diversas comunidades y regiones 
de un pais, asi como entre las diversas naciones de un continente y entre 
los diversos continentes de la tierra. Los problemas sanitarios no son 
hoy problems locales o regionales sino problemas mundiales. La nece- 
sidad de una comparacidn continental e internacional de las estadisticas 
vitales sobre bases uniformes se ha hecho asi cada dia mds y mds imperiosa. 

Es por eso que, sintiendo esa necesidad desde hace ya afios, y a pesar 
de las dificultades, se han realizado muchos y valiosos esfuerzos para 
obtener una base uniforme de comparacidn. La contribucidn de las 
Conferencias Internacionales de Revision de la Lista de Causas de Muerte; 
de las Oonferencias Sanitarias o de Higiene Piiblica, panamericanas, europ¬ 
eas y asidticas; de la Organizacidn de Higiene de la Liga de las Naciones; 
de la Oficina Internacional del Trabajo; de la Oficina Sanitaria ^Pana- 
americana; del Institute Internacional de Estadistica; del Institute 
' Interaniericano de Estadistica; del Comitd Interamcricane de Seguridad 
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Social; de la Asociaoidn Americana de Salud Publica; de los organis- 
mos estadistioos naoionales; de las asociaciones profesionales intere- 
sadas y de todos los hombres y mujeres que trabajan en los servioios 
de medicina pdblica del mundo, no debe ser olvidada, porque todos 
esos esfuerzos y contribuciones representan pasos hacia la meta comdn; 
una buena comparacion internacional sobre bases uniformes. 

Hace ya tiempo que las naciones estadfsticamente mds adelantadas 
nos ensefLaron que las estadisticas vitales son la medida del estado de 
salud de la comunidad, la representacidn de los resultados obtenidos 
por la profesidn mddica y profesiones conexas con la medicina en la 
defensa de la salud del pueblo y los guias para mejorar el trabajo del 
sanitarista, iniciar o transformar los planes de accion y solicitar la cola- 
boracidn pdblica. Pero las cifras estadisticas representan tambidn 
algo mas. Son la expresidn estdtica de los diferentes elementos bioldgi- 
cos, econoraicos, culturales y sociales de cada comunidad, estado, re¬ 
gion o pais, que influencianiiel estado de salud colectivo. 

No debe extrafiarnos asi que, en el curso de los ailos, a las simples tasas 
e indices de natalidad, morbilidad y mortalidad, se hayan ido agregando, 
en el desarrollo histdrico, datos sobre las condiciones sanitarias de las 
escuelas, el estado de la vivienda, el consume de leche y otros alimentos 
protectoros, el cuidado de la madre y el nine, la atencidn hospitalaria, 
el niimero de profesionales que trabajan en la comunidad y aun el costo 
de la atencidn medica por cada individuo atendido, como medios de 
obtener la mds axnplia y exacta informacidn posible sobre el estado de 
de salud la comunidad, regidn o pais. 

A medida que la medicina y la estadistica adquieren cada dia 
up mayor contenido social, el pensamiento y la accidn ban pasado 
gradualmente de la consideracidn unica de los problemas medicos a la 
consideracion de los problemas economicos y sociales. Los indices de 
salud van asi, poco a poco, en relacidn con el desarrollo de este pensamiento 
social, transformdndose de una simple medida del estado de salud de una 
, comunidad en un medio dtil de obtener un retrato de las relaciones entre 
el estado de salud de los hombres y mujeres de una comunidad, region 
o. pais, y el medio ambiente geogrAfico, econdmico y social en que esos 
hombres y mujeres nacen, viven, trabajan y mueren. 

La utilidad de los indices de salud, asi comprendidos, estd sefialada 
clarament por los efectivos servicios que prestan, en loe Estados .Unidos 
de Norte America, los Health Practice. InAicea^ desarrollados a 
lo largo de muqhos ahos de valiosa experiencia por el C(mmittee on Ad¬ 
ministrative Practice de la American Public Health Associatum, con la 
colaboracidn eoondmica de importants entidades interesadas en el ciudado 
de la salud pdblica, tales como el Comrnmvmyih JPund el Milbank 
. Merimial Fund. ,. . . 
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Los resultados obtenidos en un piano nacional en los Estados Unidos 
de Norte America, con los materiales y experiencias de las encuest as 
sanitarias y los formularios de apreciacidn, movieron a la Organizacion 
de Higiene de la Liga de las Naciones a iniciar el estudio, en 1935, de 
la possibilidad de una extensidn de las estadisticas vitales de higiene 
pdblica y de los indices de apreciacidn empleados^ en un piano interna- 
cional. 

En 1936, Stouman y Falk publicaron en el Boletin Trimestral 
de la Organizacion de Higiene de la Liga de las Naciones las primeras 
proposiciones, objetivas y num^ricas, de los indices de vitalidad y salud, 
condiciones del medio ambiente y actividades administrativas, que consi- 
deraban necesarios para un estudio comparado de los diversos factores 
que influyen en la salud piiblica de una colectividad. 

Este primer trabajo comprendia tres clases de cuestionarios. Uno 
detallado, con preguntas sobre la poblacion, natalidad, mortalidad 
infantil, mortalidad maternal, mortinatalidad, mortalidad general, 
morbilidad; incapacidad, alcoholismo, accideutes y homicidios; condiciones 
climdticas y topogrdficas, distribucidn social y ocupacional del a pobla- 
cidn, nivel de cultura, condiciones de habitacidn y nutrieion; gastos 
en salud piiblica persona que trabaja en los diferent servicios de medi 
cina piiblica, denuncia, investigacion y hospitalizacidn de las enfer- 
medades agudas cumunicables, lucha anti venerea y antituberculosa, 
higiene maternal, infantil y escolar, condiciones generales sanitarias, 
control. ^0 alimentos, higiene industrial, educacion sanitaria, seguros 
sociales y demds medidas de proteccion de la salud, etc. Otro abreviado, 
reducido a 100 indices sobre los tres aspectos principales, salubridad, 
medio ambiente y actividades de la medicina pdblica, y, un tercero, 
mAs corto, reducido a 60 puntos principales. 

Los trabajos, hoy ya clasicos, realizados en New Haven por Stouman 
con la colaboracidn de Departamento del Salud Piiblica de la Univer- 
sidad de Yale y los organismos estadisticos del Estado de Connecticut 
y la ciiidad de New Haven, probaron la posibilidad de aplicar los cues¬ 
tionarios de los Indices de Salud a una comunidad norteamericana. 
MAs tarde, la publicacion, por el mismo Stouman, de indices de salud 
para el distrito rural de Mczokovesd en Hungria en 1937, para la ciudad 
industrial de Bruselas en 1938 y los estudios realizados por Kacprzak 
yTomcsiken otros distritos rurales de Polonia y Hungria, probaron 
las posibilidades de su uso en las regiones rurales, tanto como en las re- 
giones industriales, y la necesidad de simplificarlos, si debian Uegai* a 
tener un cardcter intemacional. En 1938 un grupo de expertos selec- 
ciond una serie de indices aplicables a la zonas rurales y en octubre del 
mismo afto un Comitd de Indices de Salud de la Organ! zacidn de Higiene 
de la Liga de las Naciones, compuesto por representantes de los Estados 
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UnidOB^ Poldiiia, GraH Btetatia, Hungrfa, Suecia jr Prancia, fijd 52 pfb- 
pOBidiottBB para un standard intemacional qne contefnplaba Idi ttai 
aspectos ptincipales (indices de vitalidad y sAlud, indices del nciedib 
ambiente e indices de accidn pdblica) establecidos anteriormente pot 
Stouman y Falk, mientras en 1939 Selleslags aplicaba los indices rurdeS 
al estudio de la provincia belga de Luxemburgo. 

La finalidad de 16s indices de salud asi establecidos era el estudio glo¬ 
bal de la salud pdblica en sus tres grandes aspectos; la salud y vitalidad 
de los individuos, los factores del medio ambiente que los rodeaii y los 
procedimientos de lucha sanitaria utilizados. Las pregiintas sobre 
demografia, mortalidad, morbilidad, metereologia, habitacidn, sanea- 
miento, consumo, comunicaciones, instruccidn, personal y armamento 
sanitario, actividades m6dico sociales y de asistencia social, por el cardc- 
ter mixto que ahora tenian eran aplicables tanto a los medics urbanos 
como a los medics rurales. 

La Segunda Querra Mundial hizo que en la Europa ocupada, no fuera 
propicio el, ambiente para continuar desarrollando los indices de salud, 
aunque hay referencias a ellos en algunos trabajos de car&cter general, 
como el publicado por Y. B i r a u d, hoy Secretario General Adjunto 
de la Organizacidn Mundial de la Salud, sobre el estado sanitario de Eu¬ 
ropa en 1944. Es en el continente americano donde encontramos la 
continuidad de desarrollo de la aplicacidn de los indices de salud. Los 
Estados Unidos, a pesar de su gran participacidn en el esfuerzo b61ico 
mundial, continuaron mejorando sus Health Practice Indices jT America 
Latina ha realizado diversos estudios desde 1940. 

En ese afio la Delegacidn del Brasil a la IV Conferencia Panameri- 
cana de DJrectores Nacionales de Sanidad, reunida en Washington, 
presentd un formulario de nuevos indices sanitarios a la consideracidn 
la comisidn especial de dicha conferencia. Estos nuevos indices sani¬ 
tarios panamericanos, conservan el esquema general de Stouman y Falk, 
amplian al^nos rubros y suprimen otros, para hacerlos mds adaptables 
a los paises latinoamericanos. Constan de 72 pregimtas, algunas no 
muy explicitas, refiridndose 18 de ellas a los indices de vitalidad y salud, 
17, a los indices relatives al medio ambiente y 37 a las actividades de 
los servicios sanitarios. 

La mocidn del Brasil fu6 acogida favorablemente en los tdrminos si- 
guientei^ “La IV Conferencia Panamericana de Directores Nacionales 
de Sanidad, aprueba los indices sanitarios minimos que constan en Ids 
actas, y recomienda a las autoridades sanitarias, que sean aplicadas por 
via^db csiseyo en una o dos poblaciones do cada una de las Republicas 
Am5rh)aiias, y que los tesultados obtenidos sean {nesentados a la Oficina 
Sanitaria Panamericana.” 
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De acuerdo con esa rccomendacion se han publicado ya datos para 
diversas ciudados de Brasil, Cuba, Chile, Mexico, Nicaragua, Paraguay, 
Peru y Venezuela. 

En el cuadro quo se ac'ornpana resumimos las resputstas a las pre- 
guntas del cuestionario dc; los indices de salud pananiericanos. 

Que nos ensena, (!u grandes lirieas, la expericncia latinoamericana 
de la aplicacion de los indices de salud? Como resultado favorable, 
en primer lugar, su ofectiva utilidad como complcmento do las esta- 
disticas vitales, cn cuanto no>s proporcionan mayores elementos de in- 
lormacion acerca del medio ambiente y do la aeci<)n de los scrvicios .de 
medicina pfiblica, si ellos son bien axjlicados. 

En ese sentido, los priineros indices de salud, seguii los esquemas 
de Stouman y Falk modificados, son do mayor utilidad—^por considerar 
un mayor numcro de factores economicos y sociales—que los indices 
saiiitarios panamericailos, des caracter mas resiringido por ser mas 
sanitarista. Asi se exjdica que en las respuesias a dichos indices no se 
prox)orcioncn datos que existen en csos misrnos paiscs, pero que estdn 
en posesicSn de otros scrvicios tales como los del seguro social, educacidn, 
direcciones generales de estadistica, hospitaks, etc. 

Estc pimto os do iinxiortanoia, como exiieriencia, porque ninghn indice 
de salud rcflejara las (jondiciones verdaderas del estado de salud de una 
localidad, region x)ais—para fines do comparacidn—si no considera de- 
bidamente todos los factoros quo actuan sobre la salud de la poblacion, 
asi como todos los scrvicios, sin distincidn do funciones, a trave.s de los 
cuales se protege Ic salud del pueblo. 

Esta iiccesidad dc una consideracidn general del probloma se liace 
c^ada vcz m4s nccesaria, a medida que una mejor comprensioii de lo que 
(lobe ser y sera la medicina de nuestros tiempos hace desaparecer las 
divisiones entre medicina curativa y medicina preventiva, medicina 
individual y medicina colectiva, para no hablar sino de una unidad or- 
ganica; la medicina social. 

Los indices dc salud, adajitados a las particulares necesidades de cada 
estudio, son aptos para estudios de medicina social cuando consideran 
debidamente todos los factores en ella implioados. Los trabajos realizados 
en Brasil, en un analisis general do los scrvicios medicos del pais, y los 
realizados en Chile por el Departamento de Estadistica de la Direccion 
General de Beneficencia y Asistcncia Social, en relacion con la situacion 
de los hos])italcs del pais o j^or la Caja de Seguro Obligatorio, en relacion 
con la labor realizada en el seguro social, usando los indices europeos 
modificados, sou una prueba dc la adaptabilidad do dichos indices y de 
la conveniencia de su empleo como medio de encucsta previa a toda accidn 
m6dica planificada. 
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Los indices de salad son asi, a traves de -la exporiencia americana, 
(itiles como medio prActico de comparacidn y de anAlisLs de la situacion 
de xina comunidad, como medio de planificar ima accidn dica dirigida 
hacia objectivos determinados y como mAtodo de valoracion de costos 
y resultados del trabajo m6dico y de las profesiones conexas. 

A1 lado de estas ventajas, la experiencia americana, nos mnestra tam- 
biAh algunas de sus deficiencias de aplicacion. Muchas de las preguntas 
no han podido ser contestadas por la diferencia de condiciones entre los 
diversos paises de Am6rica Latina o por no aplicarse al ambiente regio¬ 
nal en estudio. Otras, por no existir datos sobre esas matcrias en los 
organismos estadisticos nacionales o en la institucidn, generalmente la 
Sanidad Pfiblica, a que pertenecian los autores (aunque, como hemos 
dioho paedan existir en otros). Varias respuestas son diferentes, por- 
que su falta de precision, deja demasiado juego a la iniciativa personal, 
o porque cuda pais puede usar diferentes unidades y metodes de trabajo. 
La periodicidad y a(in el tipo de indicc son diferentes, porque han cam- 
biado durante los atios transcurridos, por falta de informacion mas com- 
pleta de lo realizado en otros paises o por seguir demasiado fielmente 
las publicaciones antcriores efectuadas. Sin contar que pareceria necc- 
sario considerar en el cuestionario datos acerca de la medicina indus¬ 
trial, la educacidn sanitaria de la poblacion, los regimemes de seguro 
social y otros muchos puntos de interns. 

Podriamos multiplicar las criticas posibles, pero ellas no sen el objeto 
de fcste breve esbozo. Basta decir que las deficiencias hacen perder a 
log resultados mucho de su valor objetivo, aunque persista su valor 
subjetivo. 

Pero sobre todo, los diferentes trabajos realizados y el desarrollo de 
la aplicacidn de los indices de salud, perraiten desprender los prirtcipales 
problemas del momento actual. 

Parece ser el primero dc ellos el logro de un indice tal, o de varies 
indices si es necesario, que sea aplicable universolmente, conlemplando 
las variadas condiciones de vida de los paises metropolitanos y de los 
territorios no metropolitanos, de las naciones o regiones de alta indus- 
trializacidn y de los paises o regiones de escaso desarrollo industrial, 
de las poblaciones urbanas y de las poblaciones rurales y de los diferentes 
componentes Atnico-geograficos, culturales y sanitarios de las diversas 
comunidades del mundo. En este sentido una revision del texto standard 
de los indices de salud del Comite de Indices de preguerra, pareceria ser 
necesaria para poner al dia los cuestionarios de los indices do salud, con 
los adelantos de la medicina y la estadistica y con las cxperiencias ob- 
tentdas en su aplicacion, en los ultimos anos. 

Las preguntas que se hagan deberian contemplar, en la forma y can- 
ttdad adecuadas, el mayor niimero posible de elementos ecoudmiemi 
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y Boeiales que obran sobre la salud y una eerie de factorcs nueroe de in- 
ter6s para la medicina social, tales como los que se refieren, entrc otros, 
a los problomas del trabajo y a la medicina industrial, a la medicina del 
eeguro social, a la rehabilitacidn y reeducacidn profesional, al servicio 
social y la enfermeria sanitaria, a la enscfianza medica y condiciones 
de trabajo de los profcsionales de la medicina, etc., a todas las partes, 
en fin, especiales poro no independicntes, que constituyen la medicina 
social de hoy y do manana. 

Para la comparacidii internacional, la periodicidadi de elaboracion 
de los indices de salud y si es posible, su simultaneidad cn el tiempo, 
deberia ser fijada, siil perjuicio de que cada pais o institucion intcresados 
pueda efectuarlos, para sus propios fines, cuando lo estime conveniente. 
En este sentido, los recientes estiidios y gestiones efectuados per al Ins- 
tituto Interamericano de Estadistica, en relacidn con el Censo Conti¬ 
nental de las Americas en 1950, podria ser iin ejemplo de la posibilidnd 
de lograr, en el piano continental o internacional una comparacion uni¬ 
forme periddica del estado de sauld de las poblaciones, a traves de Indi¬ 


ces de salud comparables. 

Para lograr la indispensable uniformidad de metodos y de interpre- 
' tacidn, los indices de salud, no deberian ser hechos individualmente, 
sino bajo una responsabilidad oficial. Esta responsabilidad deberia 
ser, en cada comunidad, region o pais, de aquella institucidn estadistica 
oficial, nacional o local, que—en colaboracion con los otros organisoms 
estadisticos del pals, region o comunidad—pudiera darle a las respues- 
tas del cuestionario la garantia e importaiicia que requiere una con- 
testacidu completa v plena a todas sus preguntas con un solo criterio y 
con el empleo del niaximo de recursos, de tal manera que su objetivo 
informador y planificador pueda ser logrado. 

Se plantea asl indirectaTuente el problema del punto focal nacional 
para la ejecucidn e intercambio de estadisticas vitales. 

Si estos principales problemas de los indices de salud, universalidad, 
definicidn de objetivos y propdsitos, cantidad de indices a usar, pre- 
juntas que deben contener, uniformidad de metodos de recop.lacidn e 
[nterpretaoidn, unidades a emplear, periodicidad, institueion o mstitu- 
oiones reeponaables de au ejecucidn e informacidn, las trasladamoa a un 
piano internacional, vemos sus dificultades. Sin embargo, estaa difi- 
Lltades pueden ser vencidas, por los expertos bioest^isticos de los di- 
ferltes ramos de la medicina pdblica con el respaldo de una orgam- 


zacion internacional. . 

Este hecho plantea la pregunta: a quidn corresponde ocuparse intei- 

nacionalmente de los indices de salud? Creemos que en 

itual, con los precedentes que ya existen. tal pregunta 

Jtestada porque se ha reconocido plenamente que la solucidn de oiertos 
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problemas en el campo de la salud depende de una organizacidn inter- 
naoional. Esa organizacidn existe ya, aunque no todavia legalizada 
totalmente, y es la Organizacidn Mondial de la Salud de las Naciones 
Unidas. 

Corresponderla asi, segun nuestra opinion, a la Organizacidn Mon¬ 
dial de la Salud, en colaboracidn con las otras agendas especializadas 
de las Naciones Unidas y organisihos interesadcs, el ocuparse de los 
estudios tefkidientes al est^blecimien to de indices de salud uniformes 
para la comparacion internacional. La Organizacidn Mondial de la 
Salud, puede, naturalmente, si ella lo estima convenierfte, obrar 
a traves de los organismos de colaboracidn regional en sus relaciones 
nacionales. 

Es asi como, en este ligero esbozo de los principales . problemas del 
desarrollo de los indices de salud con la experiencia directa de su apli- 
cacidii en el continente iimericano, llegamos a la conclusion de su uti- 
liddd practica como instrumento de trabajo de la medicina pdblica, y 
a la necesidad de encarar la solucidn de sus principales problemas en un 
piano internacional a cargo de una organizacidn internacional represen- 
tativa. 

Si tal fuera tambien el pensamiento de los participantes en estas Con- 
ferencias Internacionales de Estadistica y las cuestiones aqui esbozadas 
llegaran a constituir un motivo para mds cuidadosos andlisis posteriores ’ 
de los expertos, nuestro pequefio trabajo habria cumplido las iin9.1idades 
que nos movieron a escribirlo. 
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R^sum^ 

Malgre un long oinploi de statistiques demographiques coniine nioyen 
de connaitre a I’etat sauitaire dc la population, la comparaison dee statis* 
tiques sanitaires continue de n'etre pas satisfaisante. Les principales 
difficultes sont: Tabsence des chifFres indispcmables dans certaines 
regions; la diversite de.s methodes utilisees pour leur compilation ou 
clasification; les divers prineipes d’iiiterpretaticn; le nombre excessif 
d’institutions nationaUs s’oecupant de statistiques demographiques; 
les difiP6rents inteiets et objectifs servant de motif aux activites de chacu- 
ne de ces institutions; et, dans certains cas, le defaut de normes appro- 
priees ou meme Tabsence de lois appropriecs dans le domaine statistique. 

La relation entre la science mediealc et la statistique avec la sociologie 
etant de jour on jour plus etroitc, les indices sanitaires deviennent fort 
utiles pour procurer ime idee exacte du rapport entre Tetat sanitaire 
de la population et le milieu geographique, economique et social. 

L’utilite d’indices sanitaires est bien prouv6e par les services trfes effi¬ 
cients rendus, aux Etats-Unis, par des indices etablis par 1’“American 
Public Health Association”. 

En 1938, une commission spcciale des indices sanitaires de TOrgamea- 
tion d’Hygi^ne de la Societe des Nations, a choisi une serie de 52 indices 
en vue d’etablir une norme internationale comprenant des indices de 
vitalite et de sante, des indices du milieu 9 t*des indices caract^risant 
Jes services de sant6 publique. 
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Le but 4e ces indices, sanitaires etait de former un apex^u complet d# 
la santi publique, consider^e sous les trois principaux aspects: sant^ 
et vitality individuelle, facteurs environnants et syst&mes de campagnes 
sanitaires. A ces fins, le questionnaire contient des questions concernant 
les domainps suivant: demographic, mortalite, morbidite, meteorologie, 
habitation, hygifene, consommation, moyens de communication, instruc¬ 
tion publique, personnel et materiel m6dicaux, activites mcdico-sociales 
et de pr6voyanco sociale. 

Toutefois, la seconde guerre mondiale empecha de continuer le d6ve- 
loppement des indices sanitaires en Europe occupee. C’est done sur le 
continent am6ricain que nous pouvons trouver de la continuite dans 
le d6veloppement des indices sanitaires. 11 a ete possible aux Etats- 
Unis d’ameliorer les indices sanitaires et TAmerique Latine a fourni 
plusieurs contributions depuis 1940. Cette annee-l^t, la delegation 
bresilienne ^ la quatrienie conference Pan Americaine de Directeurs de 
la Sante publique a propose I’introduction d’lin nouveau questionnaire 
pour les indices sanitaires, comportant 72 questions. 

Quels ont etc les enseignements de Texperience en Aim^rique Latine? 
Nous avons appris au moins une chose: Tutilite d’indices sanitaires 
comme complement des statistiques demographiques. L’experience de 
TAm^rique latine a aussi fait connaitre quelques difiBculles que Ton ren¬ 
contre dans la pratique. 

Le besoin d’un aper 9 U general sur le problcme apparait d’autant plus 
clairement qu’une connaissance plus large des fonctions sociales de la 
m^decine rompt avec la distinction faite generalement entre la medecine 
curative et preventive ou la m6decine individuelle et collective. 

Les r6sultats obtenus par ces experiences nous permettent de com- 
prendre les principaux probl^ines sanitaires d’aujourd’hui. Le premier 
de ces probl^mes semble etre d’elaborer un index ou des. indices pouvant 
ebre universellement appliques, en tenant conipte des differents standards 
de vie dans les divers pays. 
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Discussion 

Mr. E m e r s o stated, in his discussion of Mr., de V i a d o’s paper, 
that it seems to him necessary to distinguish between care of the sick 
as a medical and social service through hospitals, etc., and as a public 
health service intended to protect and promote the health of the people. 
He remarked that indices of public health services are more difficult 
to make, and proposed that they should first be formulated by medical 
administrative health officers and teachers of public health practice, 
and later tested practically in collaboration with statisticians. 



RECENT DEVELOPMENTS IN APPLICATIONS OF 
STATISTICS TO TUBERCULOSIS CONTROL 
PROGRAMS 

by Jacob Ycrushalmy 

Principal SUUiatician, Tuberculosis Control Division 
Public Health Service {United States) 

The newer demands on statistics in tuberculosis control programs re¬ 
sult primarily from a number of important recent technical developments 
and their application to the control of the disease. The more important 
of these developments are: 

1. The development of photofluorography. 

2. Newer knowledge of the j)athogenesis of tuberculosis and 
a number of diseases which simiilate it. 

3. More widespread use of BCG vaccination against tuber¬ 
culosis. 

4. Development of antibiotics, especially streptomycin, which 
may be useful in the treatment of the disease. 

5. In addition, more refined statistical methods have been 
developed to assist in specific epidemiological investigations 
of tuberculosis and its control. 

It may, therefore, be well to review some of the recent developments 
in the applications of statistics to tuberculosis control programs in the 
different fields of activity mentioned. Because of space limitation it 
is not possible to present detailed discussions on the specific statistical 
techniques utilized or developed in the different projects. This report 
must, therefore, be limited to a bare outline; more details may be found 
for many of the activities in the reference articles. In addition, certain 
activities* are mentioned for which the detailed statistical techniques 
have not yet been completely developed. Many of these will, no doubt, 
be reported in the literature in the future, when completed. It was 
thought desirable, however, to indicate in this report various types of 
activity which present different statistical problems even if these pro¬ 
blems have not, as yet, been solved. 

Photoplttokoobaphy 

The development of photofluorography provided a technique for uti- 
I lizing ^-rays in large scale tuberculosis case-finding programs. Within 
the last decade 4 number of inexpensive methods have been developed 
for obtaining chest X-ray films. These are photofluorography on 35mm.,. 

,676 
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70mm., and 4" x 5'' film sizes, and roentgenography on 14*^ x 17* paper 
negatives. All of these techniques employ automatic devices which 
permit large savings in personnel and material, so that the X-raying of 
large groups, if not the majority of the adult population, is a real possi¬ 
bility. Indeed, public and private agencies in many countries are taking 
advantage of this development to carry on this activity on a very large 
scale. 

Statistical activities which grew out of these extensive activities are 
numerous. The more important of them are associated with: 

1. FGvaluation of the diagnostic efficiency of various photofluor- 
ographic methods. 

2. Interpretation and classification of X-ray shadows. 

3. Prognosis of persons with shadows discovered in mass X-ray 
surveys. 

4. Problems in administrative statistics which concern the 
follow-up of persons with X-ray shadows discovered in mass 
surveys. 

Evaluation', In evaluating the diagnostic efficiency of different photo- 
fluorographic methods, it is necessary to obtain two measures for each 
technique: 

A measure of sensitivity or the probability of correct diagnosis 

on the positive^ cases, and 

A measure of specificity or the probability of correct diagnosis 

on the negative^ cases. 

Measures of sensitivity and specificity for the different techniques 
are obtained by comparative studies whereby a sample of the popula¬ 
tion is X-rayed at the same time by means of photofluorographic tech¬ 
nique and also by the conventional 14* x 17* celluloid film technique. 

Two statistical problems present themselves in these studies. The 
first results from the fact that in addition to differences inherent in the 
techniques there are large subjective errors of interpretation. For 
example, even on the 14* x 17* celluloid films a competent radiologist 
or chest specialist may miss as many as 25 percent of the films which 
were called “positive” by another, equally competent, interpreter. More¬ 
over, errors of almost the same magnitude are found in two independent 
interpretations by the same expert on the same set of 14* x 17* films. 

The second difficulty results from the fact that it is not known who 
in the examined population is positive and who is negative. If one of 

By “ positive ” cases are meant persons who have X-ray evidence flhgges- 
tive of tuberculosis, and “negative” eases refer to peisons who have no such 
evidence. 

73 
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. the techniques, for example, the 14^^ x I?'' celluloid is accepted as a 
standard, this difiSculty does not arise. However, in view of the rela¬ 
tively large subjective errors which exist also in the interpretation of the 
^14'' X 17'' celluloid films, it would appear more desirable to attempt an 
absolute comparison of the different techniques without reference to 
any of them as a standard. When such a comparison is attempted it 
is necessary to know who in the population has X-ray evidence of tuber¬ 
culosis, but this information can be obtained only by the use of one or 
more of the techniques tested. It is, in a sense, a vicious circle. 

A method of investigation needs, therefore, to be devised which 
would accomplish two things; it must provide an objective method of 
defining ‘^positive” cases in the examined group, and it must minimize 
as much as possible, the effects of subjective errors of interpretation, 
and at the same time accentuate the differences which are due to the tech¬ 
niques themselves. 

A recent investigation [1]^ succeeded partially in accomplishing 
these objectives. Individuals were defined as ‘‘positive” on the basis 
of evidence provided—not by a single technique, but by all techniques. 
Similarly, the interpretations of a number of competent interpreters 
were used in the definition rather than that of a single reader. Four 
different X-ray techniques were utilized in this study and the films ob¬ 
tained were interpreted independently by five different experts. These 
interpretations yielded 20 readings for each individual in the study; 
that is, each person had 20 chances of being called positive. This method 
allowed the classification of the persons examined according to different 
degrees of “positiveness” froni zero to twenty. It was thus possible to 
stratify the examined population and to compare the number of posi¬ 
tive readings obtained by each of the different techniques in the several 
categories of “positive” cases. The result obtained by this method of 
investigation was that all the techniques studied have equal efficiency 
in detecting cases of tuberculosis. 

There are a number of limitations to this method of study and great 
care must be exercised in^ testing these limitations. Nevertheless, it 
seems to be an efficient and useful method of comparison which may be 
applicable also to fields other than X-ray interpretation where similar 
problems are present. Indeed Professor Neyman has recently developed 
a mathematical formulation which, when it is completed, may provide, 
a general solution applicable to many fields. 

IfUerpretutioTi and classification of X-ray shadows^ Mass radiography 
is ordinarily conducted in population groups of apparently healthy 

* Numbers in square brackets refer to references listed at the end of this 
pajK'r. . 
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persons. Consequently, the majority of cases discovered have no symp¬ 
toms, and the only evidence of possible disease is that provided by a 
shadow on the X-ray film. In addition, the types of shadows found on 
• the^ X-rays may be somewhat different from those with which the radio¬ 
logists and chest specialists are familiar in their work in the clinic or sana¬ 
torium. As experience in mass radiography increased, it became apparent 
that the- accepted methods of interpretation and classification are not 
entirely applicable to these shadows. 

Studies of a statistical nature were undertaken, first, to evaluate the 
accepted methods of classification and their application to mass radio¬ 
graphy; second, to attempt to create different methods of classification 
of X-ray shadows which may be more useful in mass radiography even 
if they differ from those used in clinical work. These problems have, 
by no means, been solved to date; however, considerable progress has 
been made toward their solution. It has, for example, been definitely 
established that even an expert’s single reading of a set of films may miss 
as many as 25 percent of the “positive” cases.® One practical result 
of this finding was the recommendation that every set of mass X-ray 
films be interpreted independently by more than one reader. In addition, 
it was shown that the usual classification of X-ray shadows into minimal, 
moderately advanced, and far advanced tuberculosis as well as their 
classification according to probable activity of the lesion or as to its mor¬ 
phology is not suitable for lesions discovered in mass radiography. No 
two persons will, in any reasonable way, agree on these classifications 
and even a single individual is not likely to be at all consistent with him¬ 
self in two independent interpretations of the same set of films. 

Experimentation with new methods of classification has not, so far, 
yielded positive results. Solution of these problems will depend on 
Huccessful utilization of knowledge from a number of different disciplines 
such as radiology, pathology, clinical tuberculosis, statistics, physio¬ 
logical optics, and psychology. These studies are continuing now in the 
United States, but the solution is not expected for some time. 

Prognosis: The extensive activities in mass radiography brought 
to light a large number of persons with X-ray evidence of tuberculosis 
who are symptomless. Since very little experience is available on which 
to base policy in ;respect to treatment, it became necessary to establish 
long-range follow-up studies of such individuals. These involve not 
only studies of correlation between the appearance of the shadow 
with clinical and laboratory findings but also studies whose aim is to 

* i./?., cases which another reading of the same films will indicate as having X- 
ray evidence suggestive of tuberculosis. 
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determine whether prognosis of the cases can be predicted from the 
appearance of the shadow on the initial film. 

A number of important statistical problems emerge from these follow¬ 
up studies. In the first place they need to be integrated with the theo- * 
retical studies mentioned above on interpretation and classification of 
lesions. In the absence of suitable methods of interpretation and classi¬ 
fication, the studies were set up with the view of obtaining statistical 
answers to the problem of classification. In other words, simple methods 
of describing lesions and components of lesions are being developed. 
It is hoped that the significance of various appearances of a shadow will 
be brought to light in the course of the years of follow-up, when the 
future course of the lejion will be correlated with the descriptive terms 
which are being developed. There are also statistical problems in the 
quantitative assessment of changes in the appearance of a lesion on films 
which have been taken at different times. 

In addition a number of important problems in the quantitative 
assessment of clinical and laboratory techniques associated with the 
follow-up of individual cases are emerging. These, obviously, also require 
statistical treatment for their ultimate solution. 

In the main, the statistical activities in this field may be character¬ 
ized as those of keeping pace with the dynamics of changing concepts 
in radiology and tuberculosis control. This may be accomplished by 
systematic collection of data on a large number of different charac¬ 
teristics and by devising, methods of analysis which will allow the sig¬ 
nificant factors to reveal themselves. 

Administrative statistics: Mass radiography activities also created 
a number of administrative problems which required statistical treatment. 
These are of two types: those associated with the smooth operation of 
the projects, and those related to the administrative follow-up of the 
cases discovered. 

Since photofluorographic machines have a high degree of efficiency 
in examining large numbers of people in a relatively short period of 
time it became important to devise methods of recording the statistical 
data on individuals examined quickly and efficiently. The time neces¬ 
sary to record the information could not be greater than that required 
for the X-raying of the individual and yet the information must be 
sufficient to yield statistical data on the population examined and the 
amount of disease found. Various experiments with diflPerent methods 
of handling this problem were made and the methods now in practice 
make use of punch cards. These have been devised to serve several 
purpSses such as index cards for future individual reference, mechanical 
tabulation for statistics..as weU as for notifying the persons examined 
of the findings by utilization of an additional stub. There are, of course, 
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a number of detailed problems associated with this activity, many of 
which may be found in an exposition describing a record system which 
was found to work satisfactorily. [2] 

In the administrative follow-up of positive cases the problem was to 
devise means which would assist the administrator to ascertain that 
cases discovered in mass survey work are followed through. Since tuber¬ 
culosis is a chronic and prolonged disease, the statistical tools necessary 
for the continuous follow-up of these cases are not of the simplest. The 
files need to ba of a visible kind and the method of recording must be 
dynamic and adjusted to continuous changes in the status of individual 
cases. The installation and maintehaneo of such a system is a major 
operation and presents many interesting problems in administration 
and statistics. A recent manual for case record systems [3] provides 
one method of handling this problem. 


Pathoobnesis 

X ray examination of the chest constitutes only one of the tools used in 
the i^ontrol of tuberculosis. The more important additional techniques 
are bacteriological examinations for the isolation of tubercle bacilli, 
and the tuberculin test. This latter is used not only for difFerential diag¬ 
nosis, but also as an index of infection in the general population, and 
as such is very useful in public health activities. 

In treatment of an individual case, as in the Public Health aspects of 
tuberculosis control, tho interplay between the evidence provided by the 
X-ray and that furnished by supplementary tests creates a number of 
very important and interesting problems, especially when the results 
of the different tests are contradictory. It, thus, becomes necessary 
to sharpen the tools of diagnosis and to determine ihore exactly the spe¬ 
cificity of the different tests used in tuberculosis control. These prob¬ 
lems become especially acute in investigations on eatly development 
of tuberculosis and its ultimate course. For example, one of the major 
problems in tuberculosis is to determine the best test for detecting the 
development of a lesion in its incipiency. 

It is clear that many answers to these questions can be obtained by 
extensive epidemiological investigations in which statistics is the main 
tool. Specific statistical problems, in this field of activity, are associated 
with those on: 

1. Specificity of tuberculin tests 

2. Development of early tuberculosis 

3.. Diseases simulating tuberculosis ^ 

Specificity of tuberculin tests: The reaction to a tuberculin test is prer 
sumed to indicate that the person has been, i^ the past, infected with 
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tuberculosis. It does, not necessarily mean that the person has, or ever 
had, clinical tuberculosis. It is, However, necessary to exercise great 
caution in the application and interpretation of this test. In the first 
place, there apparently are great variations in the response to different 
preparations of this antigen. Secondly, and most important, it is neces¬ 
sary to consider the dose to which a reaction has been obtained, and 
thirdly, confusion exists on the simplest matter of reading the reactions 
as positive or negative. 

On the question of dosage it has been shown [4] that when the dose 
is not specified, reaction rates become meaningless. When a group of 
children had been tested consecutively by increasing doses of tubercu¬ 
lin it was found that nearly all reacted when the dose was sufficiently 
high. In other words, the notion of reaction rates has been changed to 
that of “ sensitivity levels It became possible to construct curves 
of the “ S ** shaped-cumulative type which measure sensitivity levels pf 
different population groups. If detailed and exact information about 
previous exposure were available, this method could be used to deter- 
■mine the critical level helnw wViin.li the test is specific as a measure of 

ve which the test is non-specific, 
a band around the cri.tical level is 
exposure and infection history of 
wn, the results are not sufficiently 
►reover, the problem still exists on 
parations. In a sense it is similar 
3nt types of X-ray techniques. In 
order to obtain usetul information about tuberculin, it is necessary to 
know who in the population tested has been infected with tuberculosis. 

, use must be made of 
would seem that the 
ined mainly by a care- 
degree of reaction to 
ng the response to the 
idence, and by the si- 
of different prepara- 
. in progress. 

ubercMlosis: Tuberculosis in its early stages is 
usually asymptomatic. I By the time symptoms develop the disease has, 
^ iii most cases, advanced to, such an extent that the chance of recovery of 
the patient is greatly Reduced. In addition, the damage to* the com- 
, ; munity in the form ofjtransmittal of the disease to household associates 
and ot^er contacts hai^ by that time, for the most part, been accomp- 
dished. Consequently,dt becomes iinportant to study the early manifes¬ 
tations of tuberculosis and particularly to attempt to find easy criteria 
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by which the disease may be discovered in its early stages. These con¬ 
siderations lead to seriatim studies of apparently healthy individuals 
from the time when they were free from tuberculosis to the early devel¬ 
opment of this disease. 8uch studies are being conducted on special 
groups of the. population, particularly among student nurses. These 
groups are selected primarily because they constitute a relatively easy 
group to follow and because infection in this group is relatively frequent. 

The statistical difficulties involved in such seriatim studies are well 
known. In this study the difficulties are exaggerated by the presence 
of all of the uiu^ertainties concerning tluj tests used and the differences 
in the interpretation. For example, the problems of specificity of the 
tuberculin test and the difficulties in X-ray interpretation and classi- > 
fication are present to a very high degree. On the other hand, the homo¬ 
geneity of the group as well as the additional knowledge relative to ex¬ 
posure which may be obtained in this group may be expected to assist 
greatly in the solution of the extraneous problems mentioned. 

The greatest contribution which studies of this nature are iike/y to 
make results from the existence of data on changes from 
tive. Since the individuals in such 
information becoxi(ies available on 

culin negative to tuberculin positive* -w^)l t^er 

appearaiuje. Statistical analyses of thesy -le 

formation to answer such questions, Bj#: ’ What are thP^p^P^jb measur-. 
able manifestations of the developiroht of a lesion? Is it a luberculiiy 
conversion or is it the X-ra/, or do both of these change at the same 
time? What are the intervals of time from infection to tuberculin sensi¬ 
tivity to the appearance of a lesion on the X-ray ? What is the course of 
tuberculovsis from the early stages to spontaneous recovery or to ad¬ 
vanced disease ? _ , ‘ 

Important by-products which may\^ 
relate to the specificity of the tuberculi|iti|^M|w8^TOglM’^^CTl'^ 
that test and bacterj^l ogical and X-ray • 

Diseases simulating tuberculosis: 

matic for a large proportion of the cases, X-^awd^lp^phest becoin^|he 
most potent tool in the control and management m 
is the danger, however, that some persons may be diagnosed and treated 
as tuberculous when in reality they are not. This is a consequence oi 
the fact that apparently there are other diseases which simulate tuber¬ 
culosis in the X-ray appearance of the shadow. The existence of spcl 
diseases has long been suspected from evidence provided by the fact tha 
there was a relatively large number of cases with X-ray evidence ctf tuber 
culosis, or of a previous infection with tuberculosis (calcified lesions),* 
that did not react to the tuberculin test. It woS^ however, only recently 


P^phest becoiM 
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that convincing evidence was produced which implicated two such dis¬ 
eases (coccidioidomycosis and histoplasmosis), or immunologically re¬ 
lated diseases, as causing calcifications and possibly also X-ray shadows 
very similar to those produced by tuberculosis. 

The demonstration of this fact was ac^complished by means of a care¬ 
fully conducted epidemiological-statistical study which made use of 
the facility provided by the studies on student nurses [5]. These nurses 
were tested at the same time with tuberculin and a, number of fungus 
antigens, and by means of an X-ray of the chest. Ft was established that 
nearly all nurses with X-ray evidence of (;alcification reacted either to 
tuberculin or to histoplasinin. This finding seemed to indicate that 
there must exist a disease closely ndated to histoplasmosis, which is very 
prevalent in certain })arts of this ( ountry. Considerable work has been 
done to determine the geographic prevalence of this condition and other 
interesting facts about it | fi, 7]. A number of additional epidemiolog- 
ical-statWtical studies in this field are now in progress. 


Immunization 



-s to develop an 
de. The more 
;1 Guerin—or in 
iortunately, the 
^>^ethod of vacci- 
I whereby a num- 
it tubercle bacilli, 


causing a large number of deaths. 

Within the last decade, however, many countries have begun to use 


BCG vaccination on a relatively large 



(1 it appears that its app- 
side, however, no clear- 
strolled studies have been 
tradictory, and in many 
ability of the study and 


cas accepted on its face value and ex- 
l^faave already been undertaken, it is pro- 
Z6 consRler'ewUation studies. In other countries, such 
as the Unitc'd States, where vaccination programs have not yet been ap¬ 
plied wjdcly, it may hi' hoped that the situation will permit evaluation 
studies to proceed simultaneously with the development of a service 
program. 

It. ^ay be said, without hesitation, that the success of such a com- 
• bined research-service activity depends to a great extent on the appli¬ 
cation of statistical methodology in the development of the program. 
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It is obvious that in no country could a program of vaccination be re¬ 
tarded for five to ten years in order to allow controlled follow-up studies. 
In addition, it is important to determine just how long BCG vaccination 
provides protection, if at all. Some experts express ♦he feeling that even 
if BCG provides protection in the early years, it might have the opposite 
effect in later years. 

A plan has recently been proposed in the United States whicJi not only 
combines the elements of service and research, but a])pears to have other- 
attractive features in that the vaccination procedure may be evaluated 
without utilizing the expensive method of following individual eases.* 

The plan is to vaccinate a very large number of children in the coun¬ 
try. However, it is not the intention to make this service available to 
everyone, but to vaccinate only children in selec^ted ages. For example, 
it may be possible to vaccinate all the children born in evtui years, while 
those born in odd years will be left unvaccinated. If such a plan could 
be worked out on a large scale, it would not be necessary to follow indi¬ 
vidual children, but to obtain information on the immunity ])rovided by 
BCG vaccina.. a .ady of the tuberculosis mortality curve by 

single ages, [f vaccination ])rovides immunity, it would become aj)parent 
in a rela^^ively short time that the mortality curve is not continuous, but 
dips and rises at alternate ages. The control will be perfect since all the 
children live in the same communities, subjected to the same environ¬ 
mental and other conditions. For each vaccinated age group, the experi¬ 
ence in the previous year of the unvaccinated children who are one year 
older and thv expcrit-nce in the following year of children who are one 
year younger will serv'o as controls. It will also be ])ossible to investi¬ 
gate whether the amount of protection j)rovided is de])endent on age of 
vaccination. In addition, barring very large scale population shisft, 
information will become available on the length of time j^rotection is 
provided, since the mortality curve csn be followed for many years to 
<*ome. 

Other statistical problems relating to the BCG vaccination program 
are associated with studies on specificity of the tuberculin test, since, 
presumably only non-reactors to tuberculin are to be immunized. Inci¬ 
dentally, the implication of this last statement is being subjected to in¬ 
vestigation. There are, of course, other problems such as those on the 
standardization of the product used and on methods of application. 


Antibiotics 

Although the tubercle bacillus has been isolated, known and s^tudied 
for over half a century, no specific therapy has been developed which is 
successful in curing tuberculosis in human beings. In the last few years, 

74 



58& INTERNATIONAL STATISTICAL CONFERENCES! I S I 

however, the antibiotic streptomycin has been developed and it is suffl- 
ciently promising as a cure for at least certain types of tuberculosis to 
justify extensive work on its evaluation and further development. 

Evaluation studies on streptomycin are in many respects, similar to 
evaluation studies in other fields of medicine. There is, however, one 
complicating factor in tuberculosis which may not be present in many 
other diseases. This is inherent in the chronicity of the disease and the 
difficulty in evaluating its prognosis. If streptomycin were the ‘'miracle 
drug,’* the benefits of which could be seen by the naked eye, this would 
.cause little difficulty. Unfortunately, this apparently is not the case, at 
least in the present state of the development of streptomycin. A use¬ 
ful evaluation of this drug can be obtained only by means of well con¬ 
ceived and controlled studies. In such investigations, statistical method¬ 
ology will have a great contribution to make. Fortunately, such a 
study is now being carefully planned in the United States. 

Problems confronted in such a study are of two types: selection of 
samples for the study and control groups, and methods of evaluation. In 
the first type, methods must be devised whereby the study and control 
group will contain sufficient numbers of the different types of tuberculo¬ 
sis cases, and also that the control group be as similar as is humanly 
possible to the study group with respect to a relatively large number of 
characteristics. 

In the evaluation part, all the problems mentioned previously as to 
the difficulty in X-ray interpretation and classification, particularly in 
evaluating changes in the X-ray appearance, as well as those associated 
with the evaluation of bacteriological examinations come to the fore. 
In addition very disturbing problems arise in connection with the toxi¬ 
city of the drug and the possible permanence of these toxic effects. It 
.may also lie mentioned that there is evidence that tubercle bacilli may 
develop immunity to this drug. If this should prove to be true a number 
of important epidemiological speculations as to the possible effect of 
such a phenomenon on the control of tuberculosis are of far-reaching 
interest and importance. 

It is obviously premature to say that these j)roblems have been solved, 
but it is a wholesome sign that the problems are realized in the begin¬ 
ning of this investigation and not, as in many others, at the end of the 
study. 

Statistical Techniques in Epidemiological Investigation 

The modern concept of epidemiology is much broader than that im¬ 
pliedly its name as the study of epidemics. Instead, it has come to mean 
the study of disease as a mass phenomenon leading to a better under¬ 
standing of the natural history of the disease, its source, method of spread 
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and control As such, epidemiology of necessity utilizes statistical 
techniques and methods as a major tool in many investigations. 

In epidemiological studies of acute disease, relatively simple statis¬ 
tical methods are, in the main, sufficient. However, in the eiiidemiology 
of chronic disease, such as tuberculosis, a number of complications arise 
which call for special statistical treatment. This may, iierhaps, be illus- 
trated by considering the concept of a case fatality rate, which measures 
the risk of death associated with the development of a S])ecific disease. 
In an acute disease, such as pneumonia, the rate is straight forward and 
may be obtained with relative ease. All that is required is to observe 
a number of pneumonia cases for the period of time in which the disease 
is present and to determine the number of deaths occurring among them 
in the interval. In tuberculosis the concept of a case fatality rate be¬ 
comes much more complicated and difficult even of definition. This is due 
to the duration of the disease which may, in some cases, be prolonged 
over many years, and to the wide range which may be found in the in¬ 
terval between onset of the disease and recovery or death. For these 
reasons, the concept of a case fatality rate must be changed to that of 
a survival rate. 

Similar considerations apply to such concepts as secondary attack 
rates. Those arc very useful indices in epidemiological investigations, 
in that they measure the risk of acquiring the disease when exposed to 
a known case. The determination of these rates for acute diseases is 
generally accomplished by observing for a specific period of time all 
associates in households with a known case. Since, however, the length 
of time which household associates of a tuberculosis case need to be 
observed is relatively long, many comi)lications arise. For example, *f 
secondary attack rates arc to .be determimd by age , and if the pir td of 
observation is longer than one year, the population exposed to the risk 
of acquiring the disease at a certain age cannot be determined as simply 
as in the case of acute diseases. Moreover, in actual practice the house¬ 
hold group does not remain stable for a long period of time; many per¬ 
sons are removed from or added to the group. 

To deal with problems of this type, Frost [8] has introduced Lfe table 
techniques to solve many epidemiological problems in tuberculosis. 
This method allows for continuous adjustment required by the removal 
from or addition to the group under observation, as well as for the pro- 
n * ‘finition of the group exposed to r*sk accord iig to d ff rent charcc- 
teri tics, by nibstifcuti ig pers )n-tim of e qDosu e for h ) a imb r of j r- 
soiis exposed. 

Since Frost first used this technique, a number of other investigators 
(9, 10, 11] have applied the same technique for the d^-termination of a 
number of indices which are important in epidemiological investigations 
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of tuberculosis. Among these are survival rates of persons suffering 
from tuberculosis of different degrees of seriousness; secondary attack 
rates associated with sputum positive and sputum negative cases of tu¬ 
berculosis; rates of break-down of persons with arrested or cured tu- 
berculosis and survival rates of persons who have undergone rehabili¬ 
tation after discharge from a sanatorium. 

Another important contribution of Frost to the epidemiology of tuber¬ 
culosis, also of a statistical nature, concerns the more comprehensive 
evaluation of age-specific tuberculosis mortality which is derived from 
a study of “generation” or “cohort” mortality [12]. Analysis of age- 
specific mortality curves at a given instant of time is not sufficiently com¬ 
prehensive for an understanding of many aspects of infection and immu¬ 
nity, because the curve is a composite one and the previous tuberculosis 
experience of persons of a given age at one time is different from that 
of persons of the same age in another period of time. Frost, therefore, 
reproduced the previous tuberculosis history of a group of persons by 
determining the age-specific tuberculosis mortality curve of a generation 
born in a given year. For example, the tuberculosis experience of per¬ 
sons born in 1880 (cohorts of 1880) can be traced by assigning to them 
the age specific death rates from tuberculosis which were known to have 
operated at the corresponding periods of time. The type of curve which 
results is much different from the instantaneous curve and shows, for 
example, that although at present tuberculosis mortality in the older 
ages is higher than in the younger, the older persons of today have under¬ 
gone, in previous years, higher rates and have had a peak in tubercu¬ 
losis mortality, when they were 20 to 29 years of age. By comparing 
successive cohorts by chronological decades, it was possible for Frost 
to study physical changes in resistance and to indicate that age is a very 
important factor. The same method of study is being applied now to 
other problems in the epidemiology of tuberculosis, particularly those 
relating to questions of natural immunity. 

Among the other contributions of statistics to tuberculosis control 
are its continuous uses in the day by day operations associated with the 
supervision of cases, and in the evaluation of the tuberculosis problem 
and its control. Mortality and morbidity statistics are the best measures 
available for the latter purpose. It should, however, be mentioned that 
both morbidity and mortality I'eporting are not as complete and accu¬ 
rate as would be desired and that there are a number of differences in the 
completeness and accuracy of reporting for the different countries. This 
makes comparability on an international scale difficult. It is, however, 
encour^ing that although there have, no doubt, been improvements in 
•complel/eness of reporting, the reported death rates from tuberculosis 
until the outbreak af the ^st war have been declining, in nearly all 
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countries of the world. It is also noteworthy that there is a con¬ 
tinuous change in the form of the tuberculosis mortality curve by age 
from one which had its peak at ages 20-30, to one which is continuously 
rising with age. 

The recent devastating war had a profound effect on the tuberculosis 
mortality rate in many countries which were directly affected by the 
war. Although figures are fragmentary, there seems to be little doubt 
that many of the gains made in the control of the disease have in some 
countries been wiped out and in a number of countries tuberculosis is 
now as rampant as it was more than half a century ago. 

The current evaluation of the course of tuberculosis mortality in nearly 
all countries is complicated by the very extensive population disloca¬ 
tions which have resulted directly or indirectly from the war. Very 
few countries have sufficiently detailed statistics on the population to 
determine age-specific death rates from tuberculosis. Because of this, 
there has been a greater tendency in recent years to utilize death ratios, 
or the ratios of deaths from tuberculosis to deaths from all causes, as a 
rough measure for at least the direction of the course of the disease. 
Such ratios have, of course, a number of very important limitations and 
great care must be exercised in their application. They need to be 
constructed specific for age and sex, and the other diseases must be 
studied concurrently to determine whether changes in this ratio may 
be due to extensive changes in frequencies of deaths from other diseases. 

No attempt has been made in this brief review to encompass all the 
applications of statistics to tuberculosis control programs. It is also 
not claimed that the subjects presented are the most important; they 
only happen to be those with which the author is intimately acquaint¬ 
ed. No doubt, many important activities and contributions in the 
United States and in other countries deserve eciual, if not greater, em¬ 
phasis. When this subject is viewed as a whole, it may be stated taht 
the attack on tuberculosis is proceeding in a much more organized and 
planned fashion than ever before and that statistical techniques and meth¬ 
ods are contributing in no small measure to the better understanding of 
the disease and to a more efficient utilization of available resources in 
the fight against it. 
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R4sum4 

Dans la presente communication sont discutdes les plus nouvelles 
exigence^ poshes & la statistique par les techniques d’origine rdeente 
* d»ns la lutte antituberculouse telles que la radio-photographie la vac¬ 
cination antltuberculeose au moyen du B:C.G. I’emploi de la strepto- 
■ myeine, et les nouvelles connaissabces snr la pathog^in^se de la maladie. 
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Parnii les problfemes statistiqucs qiie Ton peut abordor dans ces acti- 
viti6s beaucouptressemblent a ceux des autres domaines d’application 
d’autres sont plus specifiques. A titre d’exemple de ceux-ci on peut 
citer celui du diagnostic medical, quo Ion trouye dans les etudes compara¬ 
tives sur revaluation de Tefficacite des diverses techniques de la radio- 
photographie et de la radiographie. 

Deux problemes d’ordre statistique se presentent dans <*es etudes. 
L’un r6sulte du fait qu’en dehors des differences inherentes aux techni¬ 
ques memes, il y a d’importantes erreurs subjectives d’interpretation. 
Par exemple; meme sur les cliches a 35/42.5 cm. il est probable qu’un 
radiologue ou un clinicien phtisiologiic avise Jaissera passer inaper 9 U 
jusqu’il 25 p. 100-des cliches qu’un autre, egalement competent, a de- 
signes comme “positifs”. La seconde difficulte resulte du fait qu’il 
n’est pax conmi quels membres dc la population examinee sont positifs 
et lesqucls sont negatifs. Etant donnees les erreurs subjectives assez 
inportantes, qui existent aussi dans 1’interpretation des cliches a 35/ 
42.5 cm., il parait desirable d essayer une (^omparaison absolue des 
diverses techniques sans choisir aucune d’cntre elles comme norme. 

Si Ton aborde unc telle comparaison il sera nccessaire dc savoir quelles 
pcrsonnes dans la population, ])resentent des lesions tuberculeuses 
decelables par les examcns radiologi({ucs. mais on ne pent se renseigner 
sur (;c point que par Temploi d’unc ou de plusieurs des techniques qu’on 
voudrait mettre a repreuve. CVst un cercle vicieux, en quelque 
sorte. 

11 sera done lUH-essaire de troiiver une methode d'investigation a deux 
fins: 1) fournir unc methode objective pour definir les cas positifs du 
groupe examine, (‘-t 2) reduire. autant que possible, les effets d’erreurs 
subjectives d’interpretation, et d’autre part, accentuer les differences 
attribuables aux techni(.|ues mcmes. v 

Une investigation recente a realise ces buts en partie. On a classe 
les cas comme ‘‘positifs” selon I’evidence fournie par I’ensemble dc toutes 
les techniques, non pas par une seiile technique. D’une manifere ana¬ 
logue, an lieu dc Tinterpretation des resultats par un seul expert, les 
interpretations de plusieurs experts out etc utilisets pour le classement. 
Dans retude en question, on a employe quatre techniques differentes 
de radiologic, et cinq experts ont evalue independamment les cliches 
ainsi obtenus. Cela a fdurni vingt interpretations pour chaque individu 
compris dans I’etude; e’est-a-dire que chaque personne avait vingt 
chances d’etre designee comme “positif”. On peut classer les individus 
examines d’apres les differents degr^s de “positivite” de zero jusqu’^l 
vingt. On a done pu stratifier la population examinee et® comparef 
le nombre d’interpretations positives obtenues au moyen de chacune 
dgs diverses techniques dans les categories respectives de cas “positifs”,. 
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Cette confrontation a montr6 que toutes les techniques 4tudi4es possMent 
une efficacit^ 6gale dans le rep6rage des porteurs de lesions tubercu- 
leases. 

Cette m6thodo d’investigation a un certain nombre de limitations, 
et il faut apporter un soin extreme h Tanalyse de ces limitations. 
Neanmoins, elle parait une m^thode aussi utile qu’efficace, une methode 
qu*on pourra peut-etre appliquer k des domaines autres que Tinterpre- 
tation radiologique, dans lesquels des problfemes semblables se pr6sentent. 
En efFet, la forme mathematique que 3f. Neyman en a donn6e fournira 
peut-etre, quand on I’aura completee, une solution g^n^rale applicable 
k beaucoup de domaines. 



JACOB YERUSHALMY 
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Discussion 

Mr. N e y m a n’s contribution to the discussion, a short paper on 
the statistical treatment of the problem of diagnosis, was read in French 
by Mr. D a r m o i s. This short outline follows, with an example of 
its application omitted : 

“Every attempt at a mathematical treatment of phenomena must 
begin by building a simplified mathematical model of the phenomena. 
In studying the problem of diagnosis as presented by Mr. Yerushalmy, 
we have to consider a jiopulation (or a universe) U of individuals which 
we shall imagine divided into three exclusive categories: (i) Individuals 
entirely free from the given disease, whose proportion is a, (ii) Individuals 
moderately affected by the disease, whose proportion is /?; (iii) Very heavily 
affected persons, whose proportion is y === 1—«—/?. 

“Mr. Yerushalmy’s data and the discussion suggest that a diagnosis 
is always subject to error. Therefore we have to consider the probabi¬ 
lities of a correct outcome of the diagnosis. The probabilities are different 
for each of the three categories of individuals distinguished above. Let 
then n and p stand for the probabilities of correct diagnosis for categories 
(i) and (ii) respectively. In consequence I—tt will denote the probability 
of a healthy person being classified as ill or, to use Mr. Yerushalmy’s 
expression, the probability of a “false positive.*' The probability of 
a correct diagnosis for a very ill person is postulated to be unity. 

“The mathematical model outlined above contains four independent 
parameters with which to describe the machinery behind figures such as 
those collected by Mr. Yerushalmy: the proportions a and of the 
the population and the probabilities tt and p of a correct outcome of 
diagnosis. 

“In order to be able to estimate all the parameters in a mathematical 
model it is necessary to write down an equal number of independent 
equations and this implies at least an equal number of observed inde¬ 
pendent frequencies. Moreover, should it not only be necessary to esti¬ 
mate the unknown parameters, but also to test some hypotheses concern¬ 
ing them, the number of independent frequencies will have to be larger 
than the number of parameters. Thus if we assume the above model 
with four parameters and desire to test some hypotheses concerning it, 
then the necessary data would have to involve at least five independent 
frequencies. ^ 

“Let n denote the number of independent diagnoses made for each in¬ 
dividual of the N individuals constituting a sample from-the universe 
U, Denote by h the number of positive diagnoses made fojr a pArticulaY 
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individual. Obviously k may have one of the w+1 values 0,1, 2, n. 
Let stand for the number of individuals in the sample for which 
there were exactly k positive dagnosis. Dividing iV'j./iV' = we obtain 
i the relative of exactly k positive diagnoses in the sample. There are 
n+1 such frequencies but only n of them are independent since they 
must add up to unity. 

“It follows that, if it is desired to test some hypotheses concerning 
the four parameter models described above, the number of independent 
diagnoses made by the same method for each individual of the sample 
must be at least equal to five. If this condition is satisfied, then the 
procedure of estimating the parameters a, tt, and p may be that of 
the best asymptotically normal estimates, explained in a recent paper.^ 

“The possibility of applying this method to data collected byMr. Yeru- 
shalmy depends on whether or not one agrees to consider that these data 
are diagnoses, by the aavm method, independently applied to the same 
individuals,,,.'' 

Mr. Yerushalmy pointed out, with reference to Mr. Neyman’s paper, 
that the method was not quite complete. In the comparison of several 
techniques, even though it can be shown that, e.g., each technique diag¬ 
noses the same percentage of positive cases, essentially the method does 
not prove that the techniques are equally good, since there must also be 
success in diagnosing the right cases. 

' J. Neyman, “Gontributions to the Theory of x* Test,” Proceedings of the 
Berkeley Symposium on Mathematical Statistics and Probability, 1945, 1946, 




